eetimes.eu
robots.txt

Robots Exclusion Standard data for eetimes.eu

Resource Scan

Scan Details

Site Domain eetimes.eu
Base Domain eetimes.eu
Scan Status Ok
Last Scan2024-06-17T09:50:54+00:00
Next Scan 2024-06-24T09:50:54+00:00

Last Scan

Scanned2024-06-17T09:50:54+00:00
URL https://eetimes.eu/robots.txt
Redirect https://www.eetimes.eu/robots.txt
Redirect Domain www.eetimes.eu
Redirect Base eetimes.eu
Domain IPs 192.0.66.176, 2a04:fa87:fffd::c000:4225
Redirect IPs 23.222.131.22
Response IP 104.103.144.118
Found Yes
Hash 51e2c74d56e100a707472e6e3a06914642c990a8f8f2b5d572e4e19c7610cc9f
SimHash 7b01d8618ab2

Groups

*

Rule Path
Disallow /gf-entries-in-excel/
Disallow /gravityexport-lite/
Disallow /gravityexport/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin
Disallow /search
Disallow */embed$
Disallow */xmlrpc.php
Disallow *openstat%3D

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

moodlebot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.eetimes.eu/news-sitemap.xml
sitemap https://www.eetimes.eu/sitemap_index.xml