Log In Sign Up

powox.com
robots.txt

Robots Exclusion Standard data for powox.com

Resource Scan

Scan Details

Site Domain powox.com
Base Domain powox.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-07T19:29:15+00:00
Next Scan 2026-03-07T19:29:15+00:00

Last Successful Scan

Scanned2024-05-16T19:34:03+00:00
URL https://powox.com/robots.txt
Redirect https://www.powox.com/robots.txt
Redirect Domain www.powox.com
Redirect Base powox.com
Domain IPs 104.21.35.173, 172.67.178.16, 2606:4700:3030::ac43:b210, 2606:4700:3036::6815:23ad
Redirect IPs 104.21.35.173, 172.67.178.16, 2606:4700:3030::ac43:b210, 2606:4700:3036::6815:23ad
Response IP 172.67.178.16
Found Yes
Hash 6a4389bb5c67b60a98ce45376f3502cbcc283fe349f6259e1db6a76cdbe94fde
SimHash 565ed440c000

Groups

mediapartners-google

Rule Path
Disallow
Disallow /out/*

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin
Disallow /admin*
Disallow /out/*
Disallow /mobile
Allow /

googlebot-mobile

Rule Path
Disallow /print_userimage.php
Disallow /out/*

msnbot

Rule Path
Disallow /admin
Disallow /admin*
Disallow /out/*
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

awariobot
awariorssbot
awariosmartbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 100

awariobot
awariorssbot
awariosmartbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

bender

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 300

dotbot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 600

gptbot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 400

petalbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

seekportbot

Rule Path
Disallow /

soso

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

wesee_bot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 400

grapeshot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 400

amazonbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

verity

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

claudebot

Rule Path
Disallow /
Back to top

Warnings

  • 4 invalid lines.
Back to top