Robots.txt Tester

Inspect how tingiaxe.com controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 100

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

  • Full breakdown
  • Actionable fixes
  • Prioritized next steps

No spam. One email with your report and next steps.

Robots.txt Status

Robots.txt Status Present Score 100 /100 · Strong
Domain tingiaxe.com
Last analyzed June 16, 2026

View Full Robots.txt

Robots.txt Content Preview

# Tin Gia Xe robots.txt
# Public content is open for search engines and AI crawlers that respect robots.txt.

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-login.php
Disallow: /xmlrpc.php
Disallow: /*?replytocom=
Disallow: /*&replytocom=
Disallow: /*/feed/
Disallow: /feed/

# AI search, answer engines, assistants, and model crawlers.
# Unknown AI crawlers remain allowed by the User-agent: * group above.
User-agent: GPTBot
User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: ClaudeBot
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: anthropic-ai
User-agent: Google-Extended
User-agent: Applebot
User-agent: Applebot-Extended
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: FacebookBot
User-agent: Meta-ExternalAgent
User-agent: Meta-ExternalFetcher
User-agent: CCBot
User-agent: Bytespider
User-agent: TikTokSpider
User-agent: Amazonbot
User-agent: YouBot
User-agent: DuckAssistBot
User-agent: CohereBot
User-agent: Diffbot
User-agent: Omgilibot
User-agent: Omgili
User-agent: ia_archiver
User-agent: MistralAI-User
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-login.php
Disallow: /xmlrpc.php
Disallow: /*?replytocom=
Disallow: /*&replytocom=
Disallow: /*/feed/
Disallow: /feed/

Sitemap: https://tingiaxe.com/sitemap.xml

User-agent Rules

User-agent(s) Allowed paths Disallowed paths
*
  • /wp-admin/admin-ajax.php
  • /wp-admin/
  • /wp-login.php
  • /xmlrpc.php
  • /*?replytocom=
  • /*&replytocom=
  • /*/feed/
  • /feed/
gptbot No explicit Allow rules. No explicit Disallow rules.
oai-searchbot No explicit Allow rules. No explicit Disallow rules.
chatgpt-user No explicit Allow rules. No explicit Disallow rules.
claudebot No explicit Allow rules. No explicit Disallow rules.
claude-searchbot No explicit Allow rules. No explicit Disallow rules.
claude-user No explicit Allow rules. No explicit Disallow rules.
anthropic-ai No explicit Allow rules. No explicit Disallow rules.
google-extended No explicit Allow rules. No explicit Disallow rules.
applebot No explicit Allow rules. No explicit Disallow rules.
applebot-extended No explicit Allow rules. No explicit Disallow rules.
perplexitybot No explicit Allow rules. No explicit Disallow rules.
perplexity-user No explicit Allow rules. No explicit Disallow rules.
facebookbot No explicit Allow rules. No explicit Disallow rules.
meta-externalagent No explicit Allow rules. No explicit Disallow rules.
meta-externalfetcher No explicit Allow rules. No explicit Disallow rules.
ccbot No explicit Allow rules. No explicit Disallow rules.
bytespider No explicit Allow rules. No explicit Disallow rules.
tiktokspider No explicit Allow rules. No explicit Disallow rules.
amazonbot No explicit Allow rules. No explicit Disallow rules.
youbot No explicit Allow rules. No explicit Disallow rules.
duckassistbot No explicit Allow rules. No explicit Disallow rules.
coherebot No explicit Allow rules. No explicit Disallow rules.
diffbot No explicit Allow rules. No explicit Disallow rules.
omgilibot No explicit Allow rules. No explicit Disallow rules.
omgili No explicit Allow rules. No explicit Disallow rules.
ia_archiver No explicit Allow rules. No explicit Disallow rules.
mistralai-user
  • /wp-admin/admin-ajax.php
  • /wp-admin/
  • /wp-login.php
  • /xmlrpc.php
  • /*?replytocom=
  • /*&replytocom=
  • /*/feed/
  • /feed/

Blocked and Allowed Paths

Blocked paths
  • /wp-admin/
  • /wp-login.php
  • /xmlrpc.php
  • /*?replytocom=
  • /*&replytocom=
  • /*/feed/
  • /feed/
Allowed paths
  • /wp-admin/admin-ajax.php
Crawl-delay No Crawl-delay directive detected.

Sitemaps Detected

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Recommendations

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analyze this site with other tools

Want a website that actually generates leads?

Start a conversion-focused website project with a team that builds fast, SEO-optimized sites for real businesses.