compprime.com
robots.txt

Robots Exclusion Standard data for compprime.com

Resource Scan

Scan Details

Site Domain compprime.com
Base Domain compprime.com
Scan Status Ok
Last Scan2025-09-30T07:23:20+00:00
Next Scan 2025-10-30T07:23:20+00:00

Last Scan

Scanned2025-09-30T07:23:20+00:00
URL https://compprime.com/robots.txt
Redirect https://www.compprime.com/robots.txt
Redirect Domain www.compprime.com
Redirect Base compprime.com
Domain IPs 199.34.228.70
Redirect IPs 199.34.228.70
Response IP 199.34.228.70
Found Yes
Hash e31c6a340c7094ef83360c355f3844d1e95c3001c98e7b798e7b6afaf9195c68
SimHash 7950dce705d3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//cityofcentralia.com
Disallow /http%3A//webmail.compprime.com
Disallow /http%3A//www.ask.com
Disallow /http%3A//cityofchehalis.com
Disallow /http%3A//www.bing.com
Disallow /https%3A//e-scout.compprime.com
Disallow /webmail.html
Disallow /http%3A//lewiscountywa.gov/
Disallow /https%3A//duckduckgo.com/
Disallow /http%3A//www.google.com/movies?near=98531
Disallow /http%3A//www.google.com
Disallow /http%3A//www.yahoo.com
Disallow /http%3A//www.tvguide.com/listings/
Disallow /http%3A//www.weather.com/weather/today/Centralia%2BWA%2B98531?from=hp_promolocator&lswe=98531&lwsa=Weather36HourSchooldayCommand

Other Records

Field Value
sitemap https://www.compprime.com/sitemap.xml