alltomtrav.info
robots.txt

Robots Exclusion Standard data for alltomtrav.info

Resource Scan

Scan Details

Site Domain alltomtrav.info
Base Domain alltomtrav.info
Scan Status Ok
Last Scan2024-11-05T08:31:15+00:00
Next Scan 2024-11-12T08:31:15+00:00

Last Scan

Scanned2024-11-05T08:31:15+00:00
URL https://alltomtrav.info/robots.txt
Domain IPs 91.201.60.135
Response IP 91.201.60.135
Found Yes
Hash e4e2da773225dc3d8ba1ebdca345fc92ddf4982327b223ccecd96cc420d50599
SimHash 6948eb72c2b3

Groups

*

Rule Path
Disallow /?blackhole

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /archives/
Disallow *?replytocom
Disallow /comments/feed/

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.alltomtrav.info/sitemaps.xml

Comments

  • disallow all files in these directories