Log In Sign Up

secretm.me
robots.txt

Robots Exclusion Standard data for secretm.me

Resource Scan

Scan Details

Site Domain secretm.me
Base Domain secretm.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-04-17T06:30:17+00:00
Next Scan 2024-06-16T06:30:17+00:00

Last Successful Scan

Scanned2024-02-18T06:23:53+00:00
URL https://secretm.me/robots.txt
Domain IPs 104.21.80.245, 172.67.155.164, 2606:4700:3036::ac43:9ba4, 2606:4700:3037::6815:50f5
Response IP 172.67.155.164
Found Yes
Hash bf308d11a3b7096d350d77ec4788c715e44b72044a49765d9605a07692b75d45
SimHash d901407047b1

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /message/
Disallow /result.php?id=*
Disallow /result.php
Disallow /next.php
Disallow /next.php?id=*
Disallow /inbox.php

twitterbot

Rule Path
Allow /message.php
Allow /message/*

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /message.php
Allow /message/*

facebookexternalhit/1.1

Rule Path
Allow /message.php
Allow /message/*
Back to top

Other Records

Field Value
sitemap https://secretm.me/sitemap.xml
Back to top