pay.openai.com
robots.txt

Robots Exclusion Standard data for pay.openai.com

Resource Scan

Scan Details

Site Domain pay.openai.com
Base Domain openai.com
Scan Status Ok
Last Scan2024-11-11T14:39:37+00:00
Next Scan 2024-11-25T14:39:37+00:00

Last Scan

Scanned2024-11-11T14:39:37+00:00
URL https://pay.openai.com/robots.txt
Domain IPs 104.18.35.156, 172.64.152.100, 2606:4700:4400::6812:239c, 2606:4700:4400::ac40:9864
Response IP 172.64.152.100
Found Yes
Hash 65068e823419c0311de9bc2464b7b49a3fb449ce7e6c15bc0cf5934a873e05ee
SimHash 4c1ccaa67121

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandex

Rule Path
Disallow

ask jeeves

Rule Path
Disallow