static.thegatewaypundit.com
robots.txt

Robots Exclusion Standard data for static.thegatewaypundit.com

Resource Scan

Scan Details

Site Domain static.thegatewaypundit.com
Base Domain thegatewaypundit.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-17T22:04:46+00:00
Next Scan 2026-03-17T22:04:46+00:00

Last Successful Scan

Scanned2023-02-08T18:41:17+00:00
URL https://static.thegatewaypundit.com/robots.txt
Domain IPs 104.22.4.85, 104.22.5.85, 172.67.41.88, 2606:4700:10::6816:455, 2606:4700:10::6816:555, 2606:4700:10::ac43:2958
Response IP 104.22.4.85
Found Yes
Hash a7f4f8af3a1100627a3fda220f30885a7363329fbdae34bd1c6338e03f2a30b1
SimHash e820c8026bb2

Groups

*

Rule Path
Allow /ads.txt$
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

twitterbot

Rule Path
Allow /wp-content/