freetet.com
robots.txt

Robots Exclusion Standard data for freetet.com

Resource Scan

Scan Details

Site Domain freetet.com
Base Domain freetet.com
Scan Status Ok
Last Scan2025-12-06T19:52:01+00:00
Next Scan 2025-12-13T19:52:01+00:00

Last Scan

Scanned2025-12-06T19:52:01+00:00
URL https://freetet.com/robots.txt
Domain IPs 220.73.160.14
Response IP 220.73.160.14
Found Yes
Hash 63787c5c3ff965d445d4c752a7a00eeb4fafaa60e9a31cd1d17b98e5e20bd2af
SimHash 209089e08cb2

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-
Disallow /?s=
Disallow *%26s%3D
Disallow /search
Disallow /author/
Disallow *?attachment_id=
Disallow */feed
Disallow */rss
Disallow */embed
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf
Allow /em_it/*

gptbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

google-extended

Rule Path
Allow /

Other Records

Field Value
sitemap https://freetet.com/sitemap.xml