netzwolf.info
robots.txt

Robots Exclusion Standard data for netzwolf.info

Resource Scan

Scan Details

Site Domain netzwolf.info
Base Domain netzwolf.info
Scan Status Ok
Last Scan2024-10-09T12:14:43+00:00
Next Scan 2024-10-23T12:14:43+00:00

Last Scan

Scanned2024-10-09T12:14:43+00:00
URL https://netzwolf.info/robots.txt
Redirect https://www.netzwolf.info/robots.txt
Redirect Domain www.netzwolf.info
Redirect Base netzwolf.info
Domain IPs 2a01:4f8:d0a:10bd::2, 78.46.181.24
Redirect IPs 2a01:4f8:d0a:10bd::2, 78.46.181.24
Response IP 78.46.181.24
Found Yes
Hash 41ffae2fd0c20df4f461df88af113d325fd3db9b446a07e142dab639a5930f24
SimHash ea4c9c56fa00

Groups

*

Rule Path
Disallow /code/cgi-skripte/
Disallow /d/
Disallow /dies-und-das/emuell/txt/
Disallow /dies-und-das/htmlhorror/divide
Disallow /etc/ausgang.html
Disallow /forum/
Disallow /gaestebuch/
Disallow /meta/
Disallow /oepnv/vrs/varianten/
Disallow /rasputin.de/CF/Gina/leimrute.html
Disallow /rasputin.de/CF/Jugend/leimrute.html
Disallow /rasputin.de/CF/Psycho/leimrute.html
Disallow /rasputin.de/CF/leimrute.html
Disallow /rasputin.de/MeiFo/oscar/ergebnis_
Disallow /rasputin.de/leimrute.html
Disallow /secret/
Disallow /t/
Disallow /transformator/

twitterbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

psbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

urlspion

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.netzwolf.info/sitemap.xml.gz