search19.lycos.com
robots.txt

Robots Exclusion Standard data for search19.lycos.com

Resource Scan

Scan Details

Site Domain search19.lycos.com
Base Domain lycos.com
Scan Status Ok
Last Scan2024-04-26T02:11:59+00:00
Next Scan 2024-05-26T02:11:59+00:00

Last Scan

Scanned2024-04-26T02:11:59+00:00
URL https://search19.lycos.com/robots.txt
Domain IPs 209.202.254.90
Response IP 209.202.254.90
Found Yes
Hash d498002bc5a28aa11a9fa6d247399399f242132fdc6c9e5fad66d699bff617e9
SimHash 613908422392

Groups

*

Rule Path
Disallow /web
Disallow /sports
Disallow /b.php
Disallow /bnjs.php
Disallow /c.php
Disallow /cnjs.php

Other Records

Field Value
sitemap http://search.lycos.com/sitemap.xml