electromagnetic.net
robots.txt

Robots Exclusion Standard data for electromagnetic.net

Resource Scan

Scan Details

Site Domain electromagnetic.net
Base Domain electromagnetic.net
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-17T21:24:00+00:00
Next Scan 2024-11-18T21:24:00+00:00

Last Successful Scan

Scanned2024-11-10T21:19:41+00:00
URL http://electromagnetic.net/robots.txt
Domain IPs 13.59.85.109
Response IP 13.59.85.109
Found Yes
Hash 945e11d82b400bd28cdd0775032a95d2b00979ee9e6e2d6fe970afdeff9aeb21
SimHash 147cc970ea50

Groups

*

Rule Path
Disallow /dr/
Disallow /mrtg/
Disallow /forums/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

java

Rule Path
Disallow /

kalooga

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

portscout

Rule Path
Disallow /

psbot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

storebot-google

Rule Path
Disallow /

googleother

Rule Path
Disallow /

googleother-image

Rule Path
Disallow /

googleother-video

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /