1texte.com
robots.txt
Robots Exclusion Standard data for 1texte.com
Resource Scan
Scan Details
Site Domain | 1texte.com |
Base Domain | 1texte.com |
Scan Status | Ok |
Last Scan | 2024-11-12T16:22:47+00:00 |
Next Scan | 2024-11-19T16:22:47+00:00 |
Last Scan
Scanned | 2024-11-12T16:22:47+00:00 |
URL | https://1texte.com/robots.txt |
Domain IPs | 104.21.31.147, 172.67.177.202, 2606:4700:3032::6815:1f93, 2606:4700:3036::ac43:b1ca |
Response IP | 104.21.31.147 |
Found | Yes |
Hash | 23422f68be8d7551256fe5cd5b8c2820aa541d02b126cb9902582a0d030dc8a1 |
SimHash | 857ccd0561f1 |
Groups
*
Rule | Path |
---|---|
Disallow | /forum/categorie |
Disallow | /coming-soon/ |
Disallow | /myarticles/ |
Disallow | /avis/ |
Disallow | /memberlist/ |
Disallow | /iframe_rating_articles.php |
Disallow | /iframe_rating_tools.php |
Disallow | /send_offer.php |
Disallow | /StayAlive.php |
Disallow | /generate_sample.php |
Disallow | /comment-list.php |
Disallow | /script-paiement/index_marketplace.php |
Disallow | /outils/code/postal/*?* |
Disallow | /code/postal/*?* |
Disallow | /outils/code/postal/ |
Other Records
Field | Value |
---|---|
sitemap | https://1texte.com/sitemap.xml |