Log In Sign Up

nexverse.in
robots.txt

Robots Exclusion Standard data for nexverse.in

Resource Scan

Scan Details

Site Domain nexverse.in
Base Domain nexverse.in
Scan Status Ok
Last Scan2026-01-04T13:00:54+00:00
Next Scan 2026-02-03T13:00:54+00:00

Last Scan

Scanned2026-01-04T13:00:54+00:00
URL https://nexverse.in/robots.txt
Domain IPs 2a02:4780:11:1773:0:3abd:662a:a, 82.112.229.160
Response IP 82.112.229.160
Found Yes
Hash adadb5949e3425ac631f32427956b506b9707ecda96b22780eedc035d78924ba
SimHash 7a10f272ed66

Groups

*

Rule Path
Allow /
Allow /portfolio
Allow /pricing
Allow /quotation
Allow *.js
Allow *.css
Allow *.jpg
Allow *.png
Allow *.svg
Allow *.gif
Disallow /login
Disallow /setup
Disallow /dashboard
Disallow /admin
Disallow /*?*utm_source
Disallow /*?*utm_medium
Disallow /*?*utm_campaign

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.5

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

linkedinbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://nexverse.in/sitemap.xml
sitemap https://nexverse.in/sitemap-pages.xml
Back to top

Comments

  • Nexverse Digital Studios - SEO Configuration
  • For Web Crawlers and Search Engines
  • Default rules for all robots
  • Disallow private/admin pages
  • Disallow dynamic generated content with multiple params
  • Crawl delay (in seconds) - be respectful to slow bots
  • Request rate limit
  • Google Bot Rules
  • Bing Bot Rules
  • Twitter Bot Rules
  • Facebook Bot Rules
  • LinkedIn Bot Rules
  • Sitemap location
  • Host preference
Back to top

Warnings

  • `host` is not a known field.
  • `request-rate` is not a known field.
Back to top