autofrage.net
robots.txt

Robots Exclusion Standard data for autofrage.net

Resource Scan

Scan Details

Site Domain autofrage.net
Base Domain autofrage.net
Scan Status Ok
Last Scan2024-09-26T09:02:44+00:00
Next Scan 2024-10-03T09:02:44+00:00

Last Scan

Scanned2024-09-26T09:02:44+00:00
URL https://autofrage.net/robots.txt
Redirect https://www.autofrage.net/robots.txt
Redirect Domain www.autofrage.net
Redirect Base autofrage.net
Domain IPs 18.161.97.122, 18.161.97.35, 18.161.97.39, 18.161.97.56, 2600:9000:23d0:6600:13:337e:fc0:93a1, 2600:9000:23d0:6a00:13:337e:fc0:93a1, 2600:9000:23d0:aa00:13:337e:fc0:93a1, 2600:9000:23d0:b600:13:337e:fc0:93a1, 2600:9000:23d0:e000:13:337e:fc0:93a1, 2600:9000:23d0:ea00:13:337e:fc0:93a1, 2600:9000:23d0:ee00:13:337e:fc0:93a1, 2600:9000:23d0:f200:13:337e:fc0:93a1
Redirect IPs 18.161.97.122, 18.161.97.35, 18.161.97.39, 18.161.97.56, 2600:9000:23d0:0:13:337e:fc0:93a1, 2600:9000:23d0:1800:13:337e:fc0:93a1, 2600:9000:23d0:2200:13:337e:fc0:93a1, 2600:9000:23d0:4e00:13:337e:fc0:93a1, 2600:9000:23d0:7000:13:337e:fc0:93a1, 2600:9000:23d0:b800:13:337e:fc0:93a1, 2600:9000:23d0:cc00:13:337e:fc0:93a1, 2600:9000:23d0:d800:13:337e:fc0:93a1
Response IP 52.85.49.51
Found Yes
Hash 94d58d7c2b295f0d72d5dcf7f6b0c955f031ca0943d9b8ff0d4a37cff3b85701
SimHash 881f088007d3

Groups

googlebot

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/

bingbot

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/

duckduckbot

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/

crawler4j

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /nutzer_hinzufuegen
Disallow /home/suche
Disallow /frage_hinzufuegen
Disallow /forum
Disallow /nmms-template/
Disallow /crm-data

Other Records

Field Value
sitemap https://www.autofrage.net/sitemap.xml