internetparrot.com
robots.txt

Robots Exclusion Standard data for internetparrot.com

Resource Scan

Scan Details

Site Domain internetparrot.com
Base Domain internetparrot.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-03T06:26:06+00:00
Next Scan 2024-10-10T06:26:06+00:00

Last Successful Scan

Scanned2024-09-25T06:25:35+00:00
URL https://internetparrot.com/robots.txt
Domain IPs 2a02:4780:84:a356:c5fe:d0e6:285e:1470, 93.127.201.111
Response IP 93.127.201.100
Found Yes
Hash 2b965209fa7bc3bfa379d57236138abacfc6407fe9a6457fd80d99713115c3a1
SimHash d9a6daa26b83

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Allow /*.js*
Allow /*.css*

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://internetparrot.com/sitemap_index.xml
sitemap https://internetparrot.com/sitemap.xml
sitemap https://internetparrot.com/sitemap-1.xml
sitemap https://internetparrot.com/image-sitemap-1.xml
sitemap https://internetparrot.com/news-sitemap.xml
sitemap https://internetparrot.com/wealth/sitemap_index.xml
sitemap https://internetparrot.com/jobs/sitemap_index.xml
sitemap https://internetparrot.com/tech/sitemap_index.xml
sitemap https://internetparrot.com/insurance/sitemap_index.xml