Apache - Web Log (Activity Log)

Card Puncher Data Processing

About

Web - Log (Http log) in Apache

Format

The format of the Apache log file in Grok is:

%{IPORHOST:clientip} %{USER:ident} %{USER:auth} \[%{HTTPDATE:timestamp}\] "(?:%{WORD:verb} %{NOTSPACE:request}(?: HTTP/%{NUMBER:httpversion})?|%{DATA:rawrequest})" %{NUMBER:response} (?:%{NUMBER:bytes}|-)

Hive

This is an example of a table to parse the apache log file with hive

CREATE TABLE apachelog (
  host STRING,
  identity STRING,
  user STRING,
  time STRING,
  request STRING,
  status STRING,
  size STRING,
  referer STRING,
  agent STRING)
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.RegexSerDe'
WITH SERDEPROPERTIES (
  "input.regex" = "([^]*) ([^]*) ([^]*) (-|\\[^\\]*\\]) ([^ \"]*|\"[^\"]*\") (-|[0-9]*) (-|[0-9]*)(?: ([^ \"]*|\".*\") ([^ \"]*|\".*\"))?"
)
STORED AS TEXTFILE;





Discover More
Scale Counter Graph
How to get Started With FluentBit

FluentBit from Calyptia is a metrics collector with pipeline capacity (written in C, that works on Linux and Windows). It's the Fluentd successor with smaller memory footprint When you need to...
Php Home Path System User
Installation of Apache on Windows 10 with Apache Lounge

This article shows you how easy it is to install apache on Windows 10
Data System Architecture
Log - Logging

Log - Logging A log is a text file with: a timed list of message (activities) that an application has performed execution/request log: web server: web log ( - that stores the Http request...
Java Conceptuel Diagram
Vert.x - Web Logger

in Vert.x io/vertx/ext/web/handler/LoggerHandlerLoggerHandler is a handler which logs request information to the Vert.x logger. Example with the DEFAULT LoggerFormat....
Web - Log (Http log)

A Web Log is a log file that logs information over a request and response. See: the log from the Apache server the Nginx log The information that may be listed in a http server log are information...



Share this page:
Follow us:
Task Runner