pay.koyi.pub
robots.txt

Robots Exclusion Standard data for pay.koyi.pub

Resource Scan

Scan Details

Site Domain pay.koyi.pub
Base Domain koyi.pub
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-09T20:21:05+00:00
Next Scan 2026-01-07T20:21:05+00:00

Last Successful Scan

Scanned2023-03-02T19:38:01+00:00
URL https://pay.koyi.pub/robots.txt
Redirect https://www.koyi.pub/robots.txt
Redirect Domain www.koyi.pub
Redirect Base koyi.pub
Domain IPs 198.74.127.92
Redirect IPs 101.32.194.109
Response IP 101.32.194.109
Found Yes
Hash 3c60980ae73c475ace1265d15dc4e680ea72bfe34f20932c3622f265238fcd6e
SimHash 24555c934786

Groups

baiduspider

Rule Path
Disallow

sosospider

Rule Path
Disallow

sogou spider

Rule Path
Disallow

yodaobot

Rule Path
Disallow

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

msnbot

Rule Path
Disallow

robozilla

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

psbot

Rule Path
Disallow

naverbot

Rule Path
Disallow

*

Rule Path
Disallow /
Disallow /users
Disallow /wp-admin
Disallow /wp-includes
Disallow /goto

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://www.koyi.pub/sitemap.xml

Comments

  • robots.txt