smokeroom.com
robots.txt

Robots Exclusion Standard data for smokeroom.com

Resource Scan

Scan Details

Site Domain smokeroom.com
Base Domain smokeroom.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-18T19:30:01+00:00
Next Scan 2024-10-16T19:30:01+00:00

Last Successful Scan

Scanned2023-06-25T14:42:49+00:00
URL https://smokeroom.com/robots.txt
Redirect https://dailycaller.com/robots.txt
Redirect Domain dailycaller.com
Redirect Base dailycaller.com
Domain IPs 104.23.130.56, 104.23.131.56, 2606:4700:11::6817:8238, 2606:4700:11::6817:8338
Redirect IPs 104.23.139.7, 104.23.140.7, 2606:4700:11::6817:8b07, 2606:4700:11::6817:8c07
Response IP 104.23.139.7
Found Yes
Hash 30814e6d996a3d13f61045954311884a97669e295ece4f708003b217a13407ab
SimHash 6b1adaf3c733

Groups

applebot

Rule Path
Allow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://dailycaller.com/sitemap