projectdesignmanagement.com
robots.txt

Robots Exclusion Standard data for projectdesignmanagement.com

Resource Scan

Scan Details

Site Domain projectdesignmanagement.com
Base Domain projectdesignmanagement.com
Scan Status Ok
Last Scan2025-12-29T07:08:13+00:00
Next Scan 2026-01-28T07:08:13+00:00

Last Scan

Scanned2025-12-29T07:08:13+00:00
URL http://projectdesignmanagement.com/robots.txt
Domain IPs 77.235.38.231
Response IP 77.235.38.231
Found Yes
Hash 71d82886ad95fe52e46dab1671acf6a2274d862d648bde54fd1d5e5bead5eadc
SimHash 0865e190c7d4

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /cgi/
Disallow /frontend/
Disallow /status/
Disallow /manual/

aboutusbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

domaintools

Rule Path
Disallow /

screenshots

Rule Path
Disallow /

bingbot

Rule Path
Disallow /
Disallow

*

Rule Path
Disallow /

googlebot
msnbot
teoma
mediapartners-google*

No rules defined. All paths allowed.

Comments

  • block all other bots that ask
  • allow these bots
  • User-agent: slurp