/.well-known/

Log In Sign Up

freepornotr.de
robots.txt

Robots Exclusion Standard data for freepornotr.de

Archived Snapshots

Resource Scan

Scan Details

Site Domain	freepornotr.de
Base Domain	freepornotr.de
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server returned a server error.
Last Scan	2025-04-08T00:26:35+00:00
Next Scan	2025-06-07T00:26:35+00:00

Last Successful Scan

Scanned	2025-01-16T00:14:18+00:00
URL	https://freepornotr.de/robots.txt
Redirect	https://www.freepornotr.de/robots.txt
Redirect Domain	www.freepornotr.de
Redirect Base	freepornotr.de
Domain IPs	104.21.73.9, 172.67.136.233, 2606:4700:3030::ac43:88e9, 2606:4700:3034::6815:4909
Redirect IPs	104.21.73.9, 172.67.136.233, 2606:4700:3030::ac43:88e9, 2606:4700:3034::6815:4909
Response IP	172.67.136.233
Found	Yes
Hash	3bcafe1a9d832ee164f844b7bce7157cdfe4b9caad6efab455e32d0ee0192698
SimHash	509c4048e1b8

Groups

yandex

Rule

Path

Disallow

/*amp$

bingbot

Rule

Path

Disallow

/*amp$

ia_archiver

Rule

Path

Disallow

/

blexbot

Rule

Path

Disallow

/

dotbot

Rule

Path

Disallow

/

semrushbot

Rule

Path

Disallow

/

mj12bot

Rule

Path

Disallow

/

ahrefsbot

Rule

Path

Disallow

/

ccbot

Rule

Path

Disallow

/

chatgpt-user

Rule

Path

Disallow

/

gptbot

Rule

Path

Disallow

/

anthropic-ai

Rule

Path

Disallow

/

claudebot

Rule

Path

Disallow

/

omgilibot

Rule

Path

Disallow

/

omgili

Rule

Path

Disallow

/

facebookbot

Rule

Path

Disallow

/

twitterbot

Rule

Path

Disallow

/

diffbot

Rule

Path

Disallow

/

bytespider

Rule

Path

Disallow

/

bytedance

Rule

Path

Disallow

/

imagesiftbot

Rule

Path

Disallow

/

perplexitybot

Rule

Path

Disallow

/

cohere-ai

Rule

Path

Disallow

/

Back to top

Other Records

Field

Value

sitemap

https://www.freepornotr.de/sitemap.xml

Back to top