diff options
Diffstat (limited to 'content/html/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html')
| -rw-r--r-- | content/html/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html | 10 |
1 files changed, 5 insertions, 5 deletions
diff --git a/content/html/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html b/content/html/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html index 99dcbd3c..65e64224 100644 --- a/content/html/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html +++ b/content/html/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html @@ -9,7 +9,7 @@ img { display: block; max-width: 70%;} pre { color: #ecbe7b; } blockquote { color: #ecbe7b; } a { color: #c678dd; text-decoration: none; } -a.textlink:before { content: " > "; } +a.textlink:before { content: " > "; padding-left: 10px; } a:hover { color: #51afef; text-decoration: underline; } h1 { color: #ff6c6b; } h2, h3, h4, h5, h6 { color: #51afef; } @@ -18,18 +18,18 @@ li { color: #98be65; } </head> <body> <pre>Written by Paul Buetow 2021-04-22, last updated 2021-04-26</pre> -<a href="../">Go back to the main site</a><br /> +<a class="textlink" href="../">Go back to the main site</a><br /> <h1>DTail - The distributed log tail program</h1> <i>DTail logo image:</i><a href="./2021-04-22-dtail-the-distributed-log-tail-program/dtail-logo.png"><img alt="DTail logo image" title="DTail logo image" src="./2021-04-22-dtail-the-distributed-log-tail-program/dtail-logo.png" /></a><br /> <p>This article first appeared at the Mimecast Engineering Blog but I made it available here in my personal Gemini capsule too.</p> -<a href="https://medium.com/mimecast-engineering/dtail-the-distributed-log-tail-program-79b8087904bb">Original Mimecast Engineering Blog post at Medium</a><br /> +<a class="textlink" href="https://medium.com/mimecast-engineering/dtail-the-distributed-log-tail-program-79b8087904bb">Original Mimecast Engineering Blog post at Medium</a><br /> <p>Running a large cloud-based service requires monitoring the state of huge numbers of machines, a task for which many standard UNIX tools were not really designed. In this post, I will describe a simple program, DTail, that Mimecast has built and released as Open-Source, which enables us to monitor log files of many servers at once without the costly overhead of a full-blown log management system.</p> <p>At Mimecast, we run over 10 thousand server boxes. Most of them host multiple microservices and each of them produces log files. Even with the use of time series databases and monitoring systems, raw application logs are still an important source of information when it comes to analysing, debugging, and troubleshooting services.</p> <p>Every engineer familiar with UNIX or a UNIX-like platform (e.g., Linux) is well aware of tail , a command-line program for displaying a text file content on the terminal which is also especially useful for following application or system log files with tail -f logfile.</p> <p>Think of DTail as a distributed version of the tail program which is very useful when you have a distributed application running on many servers. DTail is an Open-Source, cross-platform, fairly easy to use, support and maintain log file analysis & statistics gathering tool designed for Engineers and Systems Administrators. It is programmed in Google Go.</p> <h2>A Mimecast Pet Project</h2> <p>DTail got its inspiration from public domain tools available already in this area but it is a blue sky from-scratch development which was first presented at Mimecast’s annual internal Pet Project competition (awarded with a Bronze prize). It has gained popularity since and is one of the most widely deployed DevOps tools at Mimecast (reaching nearly 10k server installations) and many engineers use it on a regular basis. The Open-Source version of DTail is available at:</p> -<a href="https://dtail.dev">https://dtail.dev</a><br /> +<a class="textlink" href="https://dtail.dev">https://dtail.dev</a><br /> <p>Try it out — We would love any feedback. But first, read on…</p> <h2>Differentiating from log management systems</h2> <p>Why not just use a full-blown log management system? There are various Open-Source and commercial log management solutions available on the market you could choose from (e.g. the ELK stack). Most of them store the logs in a centralised location and are fairly complex to set up and operate. Possibly they are also pretty expensive to operate if you have to buy dedicated hardware (or pay fees to your cloud provider) and have to hire support staff for it.</p> @@ -82,7 +82,7 @@ dtail –servers serverlist.txt –files ‘/var/log/*.log’ –regex ‘(?i:er </ul> <h2>Open Source</h2> <p>Mimecast highly encourages you to have a look at DTail and submit an issue for any features you would like to see. Have you found a bug? Maybe you just have a question or comment? If you want to go a step further: We would also love to see pull requests for any features or improvements. Either way, if in doubt just contact us via the DTail GitHub page.</p> -<a href="https://dtail.dev">https://dtail.dev</a><br /> +<a class="textlink" href="https://dtail.dev">https://dtail.dev</a><br /> <p>Write me an E-Mail to comments@mx.buetow.org and let me know your thoughts!</p> </body> </html> |