madrock1025.com
robots.txt

Robots Exclusion Standard data for madrock1025.com

Resource Scan

Scan Details

Site Domain madrock1025.com
Base Domain madrock1025.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T19:55:03+00:00
Next Scan 2024-09-22T19:55:03+00:00

Last Successful Scan

Scanned2024-09-14T19:54:49+00:00
URL https://madrock1025.com/robots.txt
Redirect https://www.madrock1025.com/?robots=1
Redirect Domain www.madrock1025.com
Redirect Base madrock1025.com
Domain IPs 104.21.48.85, 172.67.183.6, 2606:4700:3032::ac43:b706, 2606:4700:3035::6815:3055
Redirect IPs 104.21.48.85, 172.67.183.6, 2606:4700:3032::ac43:b706, 2606:4700:3035::6815:3055
Response IP 104.21.48.85
Found Yes
Hash 34ef9803f2ea03f74f2ff7e38f91a986a7ed62874ac80aa9138d6299c5ec5be2
SimHash 68631905e656

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow /wp-login.php
Disallow /wp-includes/*
Disallow /wp-content/*
Disallow /trackback
Disallow /feed
Disallow */comments
Disallow */comments-page-*
Disallow */trackback
Disallow */feed
Disallow */comments
Allow /wp-content/cache/*
Allow /wp-content/uploads/*
Allow /wp-content/themes/*
Allow /wp-content/plugins/*
Allow /wp-includes/js/*
Allow /wp-includes/css/*
Disallow *post_type%3Dtribe_events*
Disallow *hide_subsequent_recurrences%3D*
Disallow *tribe-bar-date%3D*
Disallow *tribe-venue%3D*
Disallow *eventDisplay%3D*
Disallow *eventDate%3D*
Disallow *paged%3D*
Disallow *pagename%3D*
Disallow *shortcode%3D*
Disallow *ical%3D*
Disallow *outlook-ical%3D*
Disallow *related_series%3D*
Disallow *tribe_geofence%3D*
Disallow *tribe_organizer%3D*
Allow /events/*
Allow /event/*

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.madrock1025.com/sitemap.xml

Warnings

  • 1 invalid line.