summaryrefslogtreecommitdiff
path: root/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html
diff options
context:
space:
mode:
authorPaul Buetow <paul@buetow.org>2024-08-26 23:07:43 +0300
committerPaul Buetow <paul@buetow.org>2024-08-26 23:07:43 +0300
commita060115f62061039758dd3cadae97889c4eadb1b (patch)
treea5b1699fa0078ea6b37fc871a40f0aef53453054 /gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html
parentc7026fd7eb994ad457419e2251403d741e98e3df (diff)
Update content for html
Diffstat (limited to 'gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html')
-rw-r--r--gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html27
1 files changed, 12 insertions, 15 deletions
diff --git a/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html b/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html
index fc51064a..df7e05e1 100644
--- a/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html
+++ b/gemfeed/2021-04-22-dtail-the-distributed-log-tail-program.html
@@ -12,13 +12,24 @@
<br />
<span class='quote'>Published at 2021-04-22T19:28:41+01:00; Updated at 2021-04-26</span><br />
<br />
+<span>This article first appeared at the Mimecast Engineering Blog but I made it available here in my personal internet site too.</span><br />
+<br />
+<a class='textlink' href='https://medium.com/mimecast-engineering/dtail-the-distributed-log-tail-program-79b8087904bb'>Original Mimecast Engineering Blog post at Medium</a><br />
+<br />
+<span>Running a large cloud-based service requires monitoring the state of huge numbers of machines, a task for which many standard UNIX tools were not really designed. In this post, I will describe a simple program, DTail, that Mimecast has built and released as Open-Source, which enables us to monitor log files of many servers at once without the costly overhead of a full-blown log management system.</span><br />
+<br />
+<span>At Mimecast, we run over 10 thousand server boxes. Most of them host multiple microservices and each of them produces log files. Even with the use of time series databases and monitoring systems, raw application logs are still an important source of information when it comes to analysing, debugging, and troubleshooting services.</span><br />
+<br />
+<span>Every engineer familiar with UNIX or a UNIX-like platform (e.g., Linux) is well aware of tail, a command-line program for displaying a text file content on the terminal which is also especially useful for following application or system log files with tail -f logfile.</span><br />
+<br />
+<span>Think of DTail as a distributed version of the tail program which is very useful when you have a distributed application running on many servers. DTail is an Open-Source, cross-platform, fairly easy to use, support and maintain log file analysis &amp; statistics gathering tool designed for Engineers and Systems Administrators. It is programmed in Google Go.</span><br />
+<br />
<a href='./dtail-the-distributed-log-tail-program/title.png'><img alt='DTail logo image' title='DTail logo image' src='./dtail-the-distributed-log-tail-program/title.png' /></a><br />
<br />
<h2 style='display: inline' id='table-of-contents'>Table of Contents</h2><br />
<br />
<ul>
<li><a href='#dtail---the-distributed-log-tail-program'>DTail - The distributed log tail program</a></li>
-<li>⇢ <a href='#introduction'>Introduction</a></li>
<li>⇢ <a href='#a-mimecast-pet-project'>A Mimecast Pet Project</a></li>
<li>⇢ <a href='#differentiating-from-log-management-systems'>Differentiating from log management systems</a></li>
<li>⇢ <a href='#combining-simplicity-security-and-efficiency'>Combining simplicity, security and efficiency</a></li>
@@ -29,20 +40,6 @@
<li>⇢ <a href='#for-the-future'>For the future</a></li>
<li>⇢ <a href='#open-source'>Open Source</a></li>
</ul><br />
-<h2 style='display: inline' id='introduction'>Introduction</h2><br />
-<br />
-<span>This article first appeared at the Mimecast Engineering Blog but I made it available here in my personal internet site too.</span><br />
-<br />
-<a class='textlink' href='https://medium.com/mimecast-engineering/dtail-the-distributed-log-tail-program-79b8087904bb'>Original Mimecast Engineering Blog post at Medium</a><br />
-<br />
-<span>Running a large cloud-based service requires monitoring the state of huge numbers of machines, a task for which many standard UNIX tools were not really designed. In this post, I will describe a simple program, DTail, that Mimecast has built and released as Open-Source, which enables us to monitor log files of many servers at once without the costly overhead of a full-blown log management system.</span><br />
-<br />
-<span>At Mimecast, we run over 10 thousand server boxes. Most of them host multiple microservices and each of them produces log files. Even with the use of time series databases and monitoring systems, raw application logs are still an important source of information when it comes to analysing, debugging, and troubleshooting services.</span><br />
-<br />
-<span>Every engineer familiar with UNIX or a UNIX-like platform (e.g., Linux) is well aware of tail, a command-line program for displaying a text file content on the terminal which is also especially useful for following application or system log files with tail -f logfile.</span><br />
-<br />
-<span>Think of DTail as a distributed version of the tail program which is very useful when you have a distributed application running on many servers. DTail is an Open-Source, cross-platform, fairly easy to use, support and maintain log file analysis &amp; statistics gathering tool designed for Engineers and Systems Administrators. It is programmed in Google Go.</span><br />
-<br />
<h2 style='display: inline' id='a-mimecast-pet-project'>A Mimecast Pet Project</h2><br />
<br />
<span>DTail got its inspiration from public domain tools available already in this area but it is a blue sky from-scratch development which was first presented at Mimecast’s annual internal Pet Project competition (awarded with a Bronze prize). It has gained popularity since and is one of the most widely deployed DevOps tools at Mimecast (reaching nearly 10k server installations) and many engineers use it on a regular basis. The Open-Source version of DTail is available at:</span><br />