metturdiary.com
robots.txt

Robots Exclusion Standard data for metturdiary.com

Resource Scan

Scan Details

Site Domain metturdiary.com
Base Domain metturdiary.com
Scan Status Ok
Last Scan2024-09-30T06:43:14+00:00
Next Scan 2024-10-07T06:43:14+00:00

Last Scan

Scanned2024-09-30T06:43:14+00:00
URL https://www.metturdiary.com/robots.txt
Domain IPs 2404:6800:4003:c1c::79, 74.125.68.121
Response IP 74.125.130.121
Found Yes
Hash 6390af2936ba3c10ea1ee4c4aa7d34eb7b8f4b2a7d4766483e89e63d2f347565
SimHash 61104b04c2d1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /comments/feed/
Disallow /trackback/
Disallow /xmlrpc.php

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap http://www.metturdiary.com/sitemap.xml