niteflirt.com
robots.txt

Robots Exclusion Standard data for niteflirt.com

Resource Scan

Scan Details

Site Domain niteflirt.com
Base Domain niteflirt.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-02-21T17:18:06+00:00
Next Scan 2024-05-21T17:18:06+00:00

Last Successful Scan

Scanned2023-04-05T13:45:41+00:00
URL https://niteflirt.com/robots.txt
Redirect https://www.niteflirt.com/robots.txt
Redirect Domain www.niteflirt.com
Redirect Base niteflirt.com
Domain IPs 18.161.97.114, 18.161.97.30, 18.161.97.36, 18.161.97.63
Redirect IPs 18.161.97.114, 18.161.97.30, 18.161.97.36, 18.161.97.63
Response IP 54.192.81.99
Found Yes
Hash b86c4f47c1d7e7995d91b8e600e3dc1a5e40f6c435dac5e5842cc63ee1e76e64
SimHash 26852d2d7450

Groups

*

Rule Path
Disallow /telco
Disallow /search
Disallow /messages
Disallow /feedbacks
Disallow /my_customers
Disallow /admin
Disallow /availability
Disallow /account

Other Records

Field Value
sitemap https://www.niteflirt.com/sitemap.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines: