ngontinhplus.com
robots.txt

Robots Exclusion Standard data for ngontinhplus.com

Resource Scan

Scan Details

Site Domain ngontinhplus.com
Base Domain ngontinhplus.com
Scan Status Ok
Last Scan2026-02-26T17:49:01+00:00
Next Scan 2026-03-05T17:49:01+00:00

Last Scan

Scanned2026-02-26T17:49:01+00:00
URL https://ngontinhplus.com/robots.txt
Domain IPs 104.21.96.151, 172.67.183.248, 2606:4700:3031::ac43:b7f8, 2606:4700:3032::6815:6097
Response IP 172.67.183.248
Found Yes
Hash 5e7995de150e751caaba590a4edb4621e9f8f02dd35808eb9b4c023cb670e697
SimHash 430944e0e61b

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Allow /wp-content/uploads/
Disallow /?s=
Disallow /search/
Disallow /cgi-bin/
Disallow /wp-login.php
Disallow /wp-register.php

amazonbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Disallow /

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://ngontinhplus.com/sitemap.xml
sitemap https://ngontinhplus.com/sitemap-novels.xml
sitemap https://ngontinhplus.com/sitemap-chapters.xml

Comments

  • Disallow admin areas
  • Allow uploads
  • Disallow search results (if any)
  • Disallow unnecessary pages
  • Sitemap