bostonplastering.com
robots.txt

Robots Exclusion Standard data for bostonplastering.com

Resource Scan

Scan Details

Site Domain bostonplastering.com
Base Domain bostonplastering.com
Scan Status Ok
Last Scan2025-04-22T10:24:10+00:00
Next Scan 2025-04-29T10:24:10+00:00

Last Scan

Scanned2025-04-22T10:24:10+00:00
URL https://bostonplastering.com/robots.txt
Redirect https://www.bostonplastering.com/robots.txt
Redirect Domain www.bostonplastering.com
Redirect Base bostonplastering.com
Domain IPs 104.21.91.123, 172.67.218.102, 2606:4700:3034::6815:5b7b, 2606:4700:3036::ac43:da66
Redirect IPs 104.21.91.123, 172.67.218.102, 2606:4700:3034::6815:5b7b, 2606:4700:3036::ac43:da66
Response IP 172.67.218.102
Found Yes
Hash 25dcce4077d8082b9899ef38e6336348029dbb4cc5c18f512055f19eb86673c4
SimHash 4254dc566793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap https://www.bostonplastering.com/sitemap.xml