flags.net
robots.txt

Robots Exclusion Standard data for flags.net

Resource Scan

Scan Details

Site Domain flags.net
Base Domain flags.net
Scan Status Ok
Last Scan2024-10-19T01:18:42+00:00
Next Scan 2024-10-26T01:18:42+00:00

Last Scan

Scanned2024-10-19T01:18:42+00:00
URL http://flags.net/robots.txt
Domain IPs 80.93.167.100
Response IP 80.93.167.100
Found Yes
Hash 4058fb826aa459423249232855e781b07f2d4c4c4e39963c7748ea004be212ca
SimHash 2945fb678dd9

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /vanda/
Disallow /newfiles/
Disallow /HS2/
Disallow /hrp2/
Disallow /vam/
Disallow /taopeking/
Disallow /sqldumps/
Disallow /old/
Disallow /fl/
Disallow /sql/
Disallow /new/
Disallow /hrp/
Disallow /nalps/
Disallow /stuff/
Disallow /beta/
Allow /

Other Records

Field Value
sitemap http://www.flags.net/Sitemap.xml

Comments

  • Mon, 06 Feb 2012 15:49:17 +0000
  • Exclude Files From All Robots:
  • Optional sitemap URL: