thebudgetreport.com
robots.txt

Robots Exclusion Standard data for thebudgetreport.com

Resource Scan

Scan Details

Site Domain thebudgetreport.com
Base Domain thebudgetreport.com
Scan Status Ok
Last Scan2024-10-17T09:37:36+00:00
Next Scan 2024-11-16T09:37:36+00:00

Last Scan

Scanned2024-10-17T09:37:36+00:00
URL https://thebudgetreport.com/robots.txt
Domain IPs 108.156.133.20, 108.156.133.56, 108.156.133.60, 108.156.133.91, 2600:9000:2755:1600:a:a05a:55c0:93a1, 2600:9000:2755:4800:a:a05a:55c0:93a1, 2600:9000:2755:6800:a:a05a:55c0:93a1, 2600:9000:2755:7400:a:a05a:55c0:93a1, 2600:9000:2755:aa00:a:a05a:55c0:93a1, 2600:9000:2755:b400:a:a05a:55c0:93a1, 2600:9000:2755:c400:a:a05a:55c0:93a1, 2600:9000:2755:ce00:a:a05a:55c0:93a1
Response IP 108.156.133.91
Found Yes
Hash 968f6edc852828d6ae6cfc6918c2e9b2a992a0a59170fc39236419f018933258
SimHash 38089cc0ea9a

Groups

*

Rule Path
Disallow /.well-known/*
Disallow /dist/*

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60