If your goal is to create a **dummy wiki data entry** listing common web crawlers for documentation or analytics reference, you can use the same tag format. Here's a plain-text example:
```text
[*|Crawler|Googlebot]
[*|Crawler|Googlebot-Image]
[*|Crawler|Googlebot-News]
[*|Crawler|Googlebot-Video]
[*|Crawler|AdsBot-Google]
[*|Crawler|Mediapartners-Google]
[*|Crawler|Bingbot]
[*|Crawler|Microsoft Bing Preview]
[*|Crawler|DuckDuckBot]
[*|Crawler|Yahoo! Slurp]
[*|Crawler|YandexBot]
[*|Crawler|Baiduspider]
[*|Crawler|Applebot]
[*|Crawler|PetalBot]
[*|Crawler|SeznamBot]
[*|Crawler|Sogou Spider]
[*|Crawler|Exabot]
[*|Crawler|Qwantify]
[*|Crawler|AhrefsBot]
[*|Crawler|SemrushBot]
[*|Crawler|MJ12bot]
[*|Crawler|DotBot]
[*|Crawler|DataForSeoBot]
[*|Crawler|CCBot]
[*|Crawler|Internet Archive]
[*|Crawler|facebookexternalhit]
[*|Crawler|Meta External Agent]
[*|Crawler|Twitterbot]
[*|Crawler|LinkedInBot]
[*|Crawler|Slackbot]
[*|Crawler|Discordbot]
[*|Crawler|TelegramBot]
[*|Crawler|Pinterestbot]
[*|Crawler|WhatsApp]
[*|Crawler|SkypeUriPreview]
[*|Crawler|Amazonbot]
[*|Crawler|ClaudeBot]
[*|Crawler|GPTBot]
[*|Crawler|ChatGPT-User]
[*|Crawler|PerplexityBot]
[*|Crawler|Bytespider]
[*|Crawler|OAI-SearchBot]
```
This is suitable as a **reference list** for wiki documentation about search engine indexing, analytics, or bot identification.
For forwarding/routing documentation, it's also common to record:
```text
[*|Protocol|HTTP]
[*|Protocol|HTTPS]
[*|Header|User-Agent]
[*|Header|X-Forwarded-For]
[*|Header|X-Forwarded-Host]
[*|Header|X-Forwarded-Proto]
[*|Header|Forwarded]
[*|Header|Via]
[*|Header|CF-Connecting-IP]
[*|Header|X-Real-IP]
[*|Header|Referer]
[*|Header|Host]
[*|Header|Accept-Language]
[*|Header|Accept-Encoding]
```
These headers are commonly used by web servers, proxies, CDNs, and analytics systems to identify clients and route requests.
Leave a Reply