undercodenews.com
robots.txt

Robots Exclusion Standard data for undercodenews.com

Resource Scan

Scan Details

Site Domain undercodenews.com
Base Domain undercodenews.com
Scan Status Ok
Last Scan6/12/2025, 6:55:29 PM
Next Scan 6/19/2025, 6:55:29 PM

Last Scan

Scanned6/12/2025, 6:55:29 PM
URL https://undercodenews.com/robots.txt
Domain IPs 104.21.37.67, 172.67.205.16, 2606:4700:3030::ac43:cd10, 2606:4700:3032::6815:2543
Response IP 172.67.205.16
Found Yes
Hash 42cb459f83a10709a937d05158c66ca8a03391e69ed85052fcc7b57cc5d81d1a
SimHash 99117d0cc937

Groups

*

Rule Path
Disallow */xhr*
Disallow */Xhr*
Disallow */wrap-xhr*
Disallow /fakelogin404/
Disallow /fakelogin403/
Allow /fakelogin403/admin-ajax.php
Allow /fakelogin404/admin-ajax.php
Disallow */wrap-function*
Disallow /index.php/*
Disallow */g00/*
Disallow /es/*
Disallow /au/*
Disallow */forums/*
Disallow */error/*
Disallow */search/*
Disallow */alert/*
Disallow */members/*
Disallow */edit/
Disallow */user/*
Disallow /*blackhole
Disallow /?blackhole
Disallow /wp-content/plugins/litespeed-cache/guest.vary.php

Other Records

Field Value
sitemap https://undercodenews.com/post-sitemap.xml
sitemap https://undercodenews.com/post-sitemap2.xml
sitemap https://undercodenews.com/page-sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449