powox.com
robots.txt

Robots Exclusion Standard data for powox.com

Resource Scan

Scan Details

Site Domain powox.com
Base Domain powox.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-07T19:29:15+00:00
Next Scan 2026-03-07T19:29:15+00:00

Last Successful Scan

Scanned2024-05-16T19:34:03+00:00
URL https://powox.com/robots.txt
Redirect https://www.powox.com/robots.txt
Redirect Domain www.powox.com
Redirect Base powox.com
Domain IPs 104.21.35.173, 172.67.178.16, 2606:4700:3030::ac43:b210, 2606:4700:3036::6815:23ad
Redirect IPs 104.21.35.173, 172.67.178.16, 2606:4700:3030::ac43:b210, 2606:4700:3036::6815:23ad
Response IP 172.67.178.16
Found Yes
Hash 6a4389bb5c67b60a98ce45376f3502cbcc283fe349f6259e1db6a76cdbe94fde
SimHash 565ed440c000

Groups

mediapartners-google

Rule Path
Disallow
Disallow /out/*

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin
Disallow /admin*
Disallow /out/*
Disallow /mobile
Allow /

googlebot-mobile

Rule Path
Disallow /print_userimage.php
Disallow /out/*

msnbot

Rule Path
Disallow /admin
Disallow /admin*
Disallow /out/*
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

awariobot
awariorssbot
awariosmartbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 100

awariobot
awariorssbot
awariosmartbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

bender

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 300

dotbot

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 600

gptbot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 400

petalbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

seekportbot

Rule Path
Disallow /

soso

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

wesee_bot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 400

grapeshot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 400

amazonbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

verity

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.