boulevards.com
robots.txt

Robots Exclusion Standard data for boulevards.com

Resource Scan

Scan Details

Site Domain boulevards.com
Base Domain boulevards.com
Scan Status Ok
Last Scan2025-10-01T02:11:50+00:00
Next Scan 2025-10-08T02:11:50+00:00

Last Scan

Scanned2025-10-01T02:11:50+00:00
URL https://boulevards.com/robots.txt
Redirect http://www.boulevards.com/robots.txt
Redirect Domain www.boulevards.com
Redirect Base boulevards.com
Domain IPs 104.21.26.75, 172.67.135.158, 2606:4700:3034::ac43:879e, 2606:4700:3035::6815:1a4b
Redirect IPs 104.21.26.75, 172.67.135.158, 2606:4700:3034::ac43:879e, 2606:4700:3035::6815:1a4b
Response IP 104.21.26.75
Found Yes
Hash dee0b96a03824c8ff1855d84a7a424b16910c23cdfd5d4f34574f8bf322c3d6d
SimHash 4a31dc72eb93

Groups

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /wp-admin/
Disallow /d/

Other Records

Field Value
crawl-delay 1