creativepool.com
robots.txt

Robots Exclusion Standard data for creativepool.com

Resource Scan

Scan Details

Site Domain creativepool.com
Base Domain creativepool.com
Scan Status Ok
Last Scan2024-10-06T06:35:44+00:00
Next Scan 2024-10-13T06:35:44+00:00

Last Scan

Scanned2024-10-06T06:35:44+00:00
URL https://creativepool.com/robots.txt
Domain IPs 104.26.12.231, 104.26.13.231, 172.67.72.32, 2606:4700:20::681a:ce7, 2606:4700:20::681a:de7, 2606:4700:20::ac43:4820
Response IP 104.26.12.231
Found Yes
Hash e23d1cbd504cfc45115f0a78659a78844b2d8396b95dcc464647b932e93b4791
SimHash 7040d862c3b3

Groups

*

Rule Path
Disallow */cv/
Disallow /cv/
Disallow */cv.orig/
Disallow */cvx/
Disallow */_orig/
Disallow /upload/
Disallow /uploads/
Disallow /login/
Disallow /_var/
Disallow /news/deleted/
Disallow /ajax/
Disallow /sign-up/?idtype=ind&step=2
Disallow /sign-up/?idtype=coy&step=2
Disallow /sign-up/?idtype=buy&step=2
Disallow /help/
Disallow /uploads/work_item/83053.pdf
Disallow /uploads/work_item/83053.doc

Other Records

Field Value
crawl-delay 10

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow
Allow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Comments

  • LNelhams