amazingandinterestingfacts.com
robots.txt

Robots Exclusion Standard data for amazingandinterestingfacts.com

Resource Scan

Scan Details

Site Domain amazingandinterestingfacts.com
Base Domain amazingandinterestingfacts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-11T20:33:43+00:00
Next Scan 2024-12-10T20:33:43+00:00

Last Successful Scan

Scanned2022-07-22T00:59:12+00:00
URL https://amazingandinterestingfacts.com/robots.txt
Redirect https://www.amazingandinterestingfacts.com/robots.txt
Redirect Domain www.amazingandinterestingfacts.com
Redirect Base amazingandinterestingfacts.com
Response IP 172.217.194.121
Found Yes
Hash dfd03b2a794b5884562c9a7d2e95f7ae1f8a28a679c4a3edeea8a1cc2c1c9202
SimHash ed14d0745fd1

Groups

*

Rule Path
Disallow /search
Disallow /category/
Disallow /tag/
Allow /

Other Records

Field Value
sitemap https://www.amazingandinterestingfacts.com/atom.xml?redirect=false&start-index=1&max-results=500
sitemap https://www.amazingandinterestingfacts.com/atom.xml?redirect=false&start-index=501&max-results=500
sitemap https://www.amazingandinterestingfacts.com/atom.xml?redirect=false&start-index=1001&max-results=500