robots.txt

1 件の投稿

Your Curl web pages may need you to add this in your robots.txt file to prevent Google search from displaying and listing your Curl code :

Disallow: /*.curl$
Disallow: /*.scurl$
Disallow: /*.mcurl$
Disallow: /*.xcurl$
Disallow: /*.pcurl$

the first 4 being the most important.

Robert Shiplett, Curlr
Fredericton NB

Canada