egpu.io
robots.txt

Robots Exclusion Standard data for egpu.io

Resource Scan

Scan Details

Site Domain egpu.io
Base Domain egpu.io
Scan Status Ok
Last Scan2024-11-16T18:39:33+00:00
Next Scan 2024-11-23T18:39:33+00:00

Last Scan

Scanned2024-11-16T18:39:33+00:00
URL https://egpu.io/robots.txt
Domain IPs 64.91.246.78
Response IP 64.91.246.78
Found Yes
Hash 45cc29922510680414f699a34d7cad4469afb7d3aaa8fea14862aa31f4a7ba97
SimHash 4f15dba6c313

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /nando4-ti-ban/
Disallow /go/

*

Rule Path
Disallow /

opebot-v (https://www.1plusx.com (https://www.1plusx.com/))

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adidxbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

applebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-mobile

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

redditbot

Rule Path
Allow /

slurp

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandexmobilebot

Rule Path
Allow /

yandexvideo

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandexsitelinks

Rule Path
Allow /

Other Records

Field Value
sitemap https://egpu.io/forums/sitemap.xml