advent-asbestos.com
robots.txt

Robots Exclusion Standard data for advent-asbestos.com

Resource Scan

Scan Details

Site Domain advent-asbestos.com
Base Domain advent-asbestos.com
Scan Status Ok
Last Scan2025-05-25T15:39:40+00:00
Next Scan 2025-06-24T15:39:40+00:00

Last Scan

Scanned2025-05-25T15:39:40+00:00
URL https://advent-asbestos.com/robots.txt
Redirect https://www.advent-asbestos.com/robots.txt
Redirect Domain www.advent-asbestos.com
Redirect Base advent-asbestos.com
Domain IPs 199.34.228.44
Redirect IPs 199.34.228.44
Response IP 199.34.228.44
Found Yes
Hash 6482f2323763939099d83a01a90b5fffea1cf9b51f301c25d9faec0b1e9a9046
SimHash 7304d41c2693

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /https%3A//www.epa.gov/asbestos
Disallow /https%3A//www.epa.gov/mold
Disallow /http%3A//
Disallow /https%3A//www.colorado.gov/cdphe/categories/services-and-information/environment/asbestos
Disallow /https%3A//www.colorado.gov/pacific/cdphe/leadpaint
Disallow /https%3A//www.colorado.gov/pacific/sites/default/files/AP_ASB_ColoradoGeneralAbatementContractors.pdf
Disallow /resources.html
Disallow /booking.html

Other Records

Field Value
sitemap https://www.advent-asbestos.com/sitemap.xml