01porno.club
robots.txt

Robots Exclusion Standard data for 01porno.club

Resource Scan

Scan Details

Site Domain 01porno.club
Base Domain 01porno.club
Scan Status Ok
Last Scan2024-05-09T21:21:42+00:00
Next Scan 2024-06-08T21:21:42+00:00

Last Scan

Scanned2024-05-09T21:21:42+00:00
URL https://01porno.club/robots.txt
Domain IPs 91.208.175.120
Response IP 91.208.175.120
Found Yes
Hash 75f1238f02c221dcc72e4f132f862839dd5e6cc8cc6ac687007250e3c53db921
SimHash 7154ab0cec91

Groups

mj12bot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

cohere-ai
perplexitybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

*

Rule Path
Disallow /promo/
Disallow /livecam/
Disallow /prm/
Disallow /prm03/
Disallow /err0r/
Disallow /performerAction/filterStats/