advent-asbestos.com
robots.txt

Robots Exclusion Standard data for advent-asbestos.com

Resource Scan

Scan Details

Site Domain advent-asbestos.com
Base Domain advent-asbestos.com
Scan Status Ok
Last Scan2025-11-21T20:51:20+00:00
Next Scan 2025-12-21T20:51:20+00:00

Last Scan

Scanned2025-11-21T20:51:20+00:00
URL https://advent-asbestos.com/robots.txt
Redirect https://www.advent-asbestos.com/robots.txt
Redirect Domain www.advent-asbestos.com
Redirect Base advent-asbestos.com
Domain IPs 199.34.228.44
Redirect IPs 199.34.228.44
Response IP 199.34.228.44
Found Yes
Hash 99704013c4b7f2644d0fbb34748bf86dac1b2be2e9b13b6e648319293b139b96
SimHash 304cd49c2693

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//www.epa.gov/asbestos
Disallow /https%3A//www.epa.gov/mold
Disallow /http%3A//
Disallow /https%3A//www.colorado.gov/cdphe/categories/services-and-information/environment/asbestos
Disallow /https%3A//www.colorado.gov/pacific/cdphe/leadpaint
Disallow /https%3A//www.colorado.gov/pacific/sites/default/files/AP_ASB_ColoradoGeneralAbatementContractors.pdf
Disallow /resources.html
Disallow /terms-website.html
Disallow /privacy-policy-website.html
Disallow /payments.html
Disallow /blog2.html
Disallow /images.html

Other Records

Field Value
sitemap https://www.advent-asbestos.com/sitemap.xml