diyadinnet.com
robots.txt
Robots Exclusion Standard data for diyadinnet.com
Resource Scan
Scan Details
| Site Domain | diyadinnet.com |
| Base Domain | diyadinnet.com |
| Scan Status | Ok |
| Last Scan | 2024-09-22T08:52:22+00:00 |
| Next Scan | 2024-09-29T08:52:22+00:00 |
Last Scan
| Scanned | 2024-09-22T08:52:22+00:00 |
| URL | https://diyadinnet.com/robots.txt |
| Redirect | https://www.diyadinnet.com/robots.txt |
| Redirect Domain | www.diyadinnet.com |
| Redirect Base | diyadinnet.com |
| Domain IPs | 185.19.92.133 |
| Redirect IPs | 185.19.92.133 |
| Response IP | 185.19.92.133 |
| Found | Yes |
| Hash | 5925056d1c983f57e021fa215f09e717c416e09b5643b68b225b0385d515f2c3 |
| SimHash | f99e59a609d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /includes/ |
| Disallow | /blocks/ |
| Disallow | /language/ |
| Disallow | /haberleri/ |
| Disallow | /db/ |
| Disallow | /abuse/ |
| Disallow | /resimler/ |
| Disallow | /dosyalar/ |
| Disallow | /cgi-bin/ |
| Disallow | /albums/ |
| Disallow | /thumbnails/ |
| Disallow | /*ref%3D* |
| Disallow | /*%3Dfriend* |
| Disallow | /arabul/ |
| Disallow | /diyet/ |
| Disallow | /m/ |
| Disallow | /forumtags/ |
| Disallow | /*mode%3Dquote* |
| Disallow | /*Hikayeler* |
| Disallow | /Komik-Yazilar* |
| Disallow | /HikayeBul* |
| Disallow | /KomikYazi* |
| Disallow | /KomikYaziEkle |
| Disallow | /Sarki-Sozleri |
| Disallow | /kilo_vermek |
| Disallow | /Sms-Sozleri |
| Disallow | /SarkiSozu* |
| Disallow | /*%3Dad_click |
| Disallow | /Burclar* |
| Disallow | /Sa%C4%9Fl%C4%B1k-Bilgisi |
| Disallow | /*function* |
| Disallow | /*sa%C4%9Fl%C4%B1k-0* |
| Disallow | /komiksesler* |
| Disallow | /ile-ilgili-bilgiler/ |
| Disallow | /Gazete-* |
| Disallow | /Sa%C4%9Fl%C4%B1k-Bilgisi |
| Disallow | /vt-* |
| Disallow | /hikayeler.php |
| Disallow | /modules.php?name=News&file=print&sid=* |
zealbot
msiecrawler
sitesnagger
webstripper
webcopier
mozilla/3.0 (compatible; indy library)
fetch
offline explorer
teleport
gigabot
teleportpro
teleport pro
webzip
linko
httrack
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
xenu
larbin
libwww
zyborg
download ninja
linkwalker
libwww-perl/5.79
microsoft data access internet publishing provider protocol discovery
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.diyadinnet.com/sitemap.xml |
| sitemap | https://www.diyadinnet.com/sitemaps/sitemap-news.php |