mozaxxx.com
robots.txt

Robots Exclusion Standard data for mozaxxx.com

Resource Scan

Scan Details

Site Domain mozaxxx.com
Base Domain mozaxxx.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-18T00:09:43+00:00
Next Scan 2024-10-16T00:09:43+00:00

Last Successful Scan

Scanned2023-03-11T01:56:49+00:00
URL https://mozaxxx.com/robots.txt
Domain IPs 104.21.35.41, 172.67.213.46, 2606:4700:3030::6815:2329, 2606:4700:3035::ac43:d52e
Response IP 172.67.213.46
Found Yes
Hash 3fe86cd99ad6dd75d19306fbddc0d34cbc3ed602b686fe4e2d839f14ba92b3e4
SimHash 25410f26d752

Groups

*

Rule Path
Disallow /download.php
Disallow /ydls.php
Disallow /yt/
Disallow /player.php
Disallow /find.php
Disallow /sitemapxml.php
Disallow /dmca.php
Disallow /contactus.php

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.mozaxxx.com/sitemap_1.xml

Comments

  • Disallow: /download/*
  • Disallow: /album/*

Warnings

  • `host` is not a known field.