ditsibits.ml
robots.txt
Robots Exclusion Standard data for ditsibits.ml
Resource Scan
Scan Details
Site Domain | ditsibits.ml |
Base Domain | ditsibits.ml |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-08-14T14:08:15+00:00 |
Next Scan | 2024-11-12T14:08:15+00:00 |
Last Successful Scan
Scanned | 2023-07-20T01:23:23+00:00 |
URL | http://ditsibits.ml/robots.txt |
Redirect | https://www.ditsibits.ml/robots.txt |
Redirect Domain | www.ditsibits.ml |
Redirect Base | ditsibits.ml |
Response IP | 88.18.43.237 |
Found | Yes |
Hash | 524b8bbabac63f847a233b3502edef0326162e8895717291b2482762865df4db |
SimHash | 73bf5263c8e1 |
Groups
*
Rule | Path |
---|---|
Allow | *.html$ |
Allow | *.php$ |
Allow | robots.txt |
Allow | *.xml$ |
Disallow | *.txt$ |
Disallow | /*? |
Disallow | /imagen/ |
Disallow | /img/ |
Allow | /js/ |
Disallow | /AWStats/ |
Disallow | /cgi-bin/ |
Disallow | /cp/ |
Disallow | /css/ |
Disallow | /so/ |
Disallow | /ibg/ |
Allow | /bgcb/ |
Allow | /bloqueig/ |
Disallow | /webalizer/ |
Disallow | /webs/ |
Disallow | /whois/ |
Disallow | /emb_godella/ |
Disallow | /basket_oam/ |
Disallow | /piwik/ |
Disallow | /fonotecaderadio_2013/ |
Disallow | /yourls/ |
Disallow | /phpsysinfo/ |
Disallow | /parkmail/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.ditsibits.ml/sitemap.xml |
Comments