thabet.cc
robots.txt

Robots Exclusion Standard data for thabet.cc

Resource Scan

Scan Details

Site Domain thabet.cc
Base Domain thabet.cc
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-26T12:08:26+00:00
Next Scan 2025-11-24T12:08:26+00:00

Last Successful Scan

Scanned2024-07-09T18:58:16+00:00
URL https://thabet.cc/robots.txt
Redirect https://thabet.live/robots.txt
Redirect Domain thabet.live
Redirect Base thabet.live
Domain IPs 104.21.1.51, 172.67.128.139, 2606:4700:3030::ac43:808b, 2606:4700:3036::6815:133
Redirect IPs 104.21.1.253, 172.67.128.111, 2606:4700:3031::ac43:806f, 2606:4700:3033::6815:1fd
Response IP 104.21.1.253
Found Yes
Hash 43b7de52d2d7c0048f8eb058d1e1565a59b07214b51e0446b1fac3a6d92ad776
SimHash af437842c821

Groups

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /search?q=*
Disallow /mobilenav/
Disallow /mobilebtmnav/
Disallow /bottomnav/
Disallow /nav/
Allow /wp-admin/admin-ajax.php
Disallow */attachment/*
Disallow /images/
Disallow *?replytocom
Disallow /page/
Allow /*.js$
Allow /*.css$

Other Records

Field Value
sitemap https://thabet.me/sitemap.xml