process-worldwide.com
robots.txt

Robots Exclusion Standard data for process-worldwide.com

Resource Scan

Scan Details

Site Domain process-worldwide.com
Base Domain process-worldwide.com
Scan Status Ok
Last Scan2024-09-16T07:36:33+00:00
Next Scan 2024-09-23T07:36:33+00:00

Last Scan

Scanned2024-09-16T07:36:33+00:00
URL https://process-worldwide.com/robots.txt
Redirect https://www.process-worldwide.com/robots.txt
Redirect Domain www.process-worldwide.com
Redirect Base process-worldwide.com
Domain IPs 81.173.115.24
Redirect IPs 81.173.115.24
Response IP 81.173.115.24
Found Yes
Hash 6ad9d41e2efa16953549664a69811e26401f069ce7907275ba7e39615af9af08
SimHash 52284a614533

Groups

yandex

Rule Path
Disallow */preview/*

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /
Disallow */preview/*

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

trendictionbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.process-worldwide.com/sitemap.xml