erkeklersoruyor.com
robots.txt
Robots Exclusion Standard data for erkeklersoruyor.com
Resource Scan
Scan Details
Site Domain | erkeklersoruyor.com |
Base Domain | erkeklersoruyor.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-15T00:10:13+00:00 |
Next Scan | 2024-12-15T00:10:13+00:00 |
Last Successful Scan
Scanned | 2024-10-17T00:07:46+00:00 |
URL | https://erkeklersoruyor.com/robots.txt |
Redirect | https://www.erkeklersoruyor.com/robots.txt |
Redirect Domain | www.erkeklersoruyor.com |
Redirect Base | erkeklersoruyor.com |
Domain IPs | 104.21.75.169, 172.67.179.66, 2606:4700:3030::6815:4ba9, 2606:4700:3037::ac43:b342 |
Redirect IPs | 104.21.75.169, 172.67.179.66, 2606:4700:3030::6815:4ba9, 2606:4700:3037::ac43:b342 |
Response IP | 104.21.75.169 |
Found | Yes |
Hash | 3c3049e0b8fed5fd126ddcbcb521c76c54e50389b237a1879697f1f7c6cdcc88 |
SimHash | da5506863571 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /content/images/* |
Disallow | */img/* |
Disallow | /images/* |
Disallow | */home/* |
Disallow | /question/* |
Disallow | /article/* |
Disallow | /logotest.html |
Disallow | /uye/* |
Disallow | /ara?* |
Disallow | /show-ad?* |
Disallow | */ask-iliskileri/* |
Disallow | */kizlarsoruyor/* |
Disallow | */toplum-sosyal-iliskiler/* |
Disallow | */magazin-filmler/* |
Disallow | */egitim-kariyer/* |
Disallow | */alisveris-hediyeler/* |
Disallow | */diger/* |
Disallow | */kisilik-karakter/* |
Disallow | */saglik/* |
Disallow | */gundem/* |
Disallow | */redirect/* |
Disallow | */second-homepage?* |
Disallow | */gagtesting/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.erkeklersoruyor.com/sitemaps/sitemaps.xml |