fanfiction.de
robots.txt

Robots Exclusion Standard data for fanfiction.de

Resource Scan

Scan Details

Site Domain fanfiction.de
Base Domain fanfiction.de
Scan Status Ok
Last Scan2024-10-30T19:28:48+00:00
Next Scan 2024-11-06T19:28:48+00:00

Last Scan

Scanned2024-10-30T19:28:48+00:00
URL http://fanfiction.de/robots.txt
Redirect https://www.fanfiktion.de/robots.txt
Redirect Domain www.fanfiktion.de
Redirect Base fanfiktion.de
Domain IPs 162.55.34.150, 2a01:4f8:c012:e1ba::1bb
Redirect IPs 128.140.107.32, 167.235.237.42, 2a01:4f8:1c1b:87b8::ffde, 2a01:4f8:c012:e042::ffde, 2a01:4f8:c013:227b::ffde, 49.13.121.172
Response IP 167.235.237.42
Found Yes
Hash 537325f8c6c2681cd2c40b6eaf48c3aa0909704bc246b20818a061bf378d8d0b
SimHash 10355950c153

Groups

ia_archiver

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /