[sysadmins] Logwatch for berlin.mcs.anl.gov (Linux)

20 Sep 2013

      ################### Logwatch 7.3 (03/24/06) #################### 
        Processing Initiated: Fri Sep 20 04:02:03 2013
        Date Range Processed: yesterday
                              ( 2013-Sep-19 )
                              Period is day.
      Detail Level of Output: 0
              Type of Output: unformatted
           Logfiles for Host: berlin.mcs.anl.gov
  ################################################################## 

 --------------------- Selinux Audit Begin ------------------------ 

 **Unmatched Entries** 
  auditd invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=-17

 ---------------------- Selinux Audit End ------------------------- 

 --------------------- Automount Begin ------------------------ 

 **Unmatched Entries**
 key "mg" not found in map source(s).: 1 Time(s)
 key "sc" not found in map source(s).: 1 Time(s)
 key "gm" not found in map source(s).: 1 Time(s)

 ---------------------- Automount End ------------------------- 

 --------------------- Cron Begin ------------------------ 

 **Unmatched Entries**
 error: Job execution of per-minute job scheduled for 18:09 delayed into subsequent minute 18:10. Skipping job run.
 Sep 19 18:10:08 berlin crond[5780]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 18:11 delayed into subsequent minute 18:13. Skipping job run.
 Sep 19 18:13:58 berlin crond[5791]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 18:12 delayed into subsequent minute 18:13. Skipping job run.
 Sep 19 18:13:58 berlin crond[5796]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 18:13 delayed into subsequent minute 18:14. Skipping job run.
 Sep 19 18:15:13 berlin crond[5800]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 18:22 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:14 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:15 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:17 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:19 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:23 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:17 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:24 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:20 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:21 delayed into subsequent minute 18:25. Skipping job run.
 error: Job execution of per-minute job scheduled for 18:18 delayed into subsequent minute 18:25. Skipping job run.
 Sep 19 18:25:30 berlin crond[5824]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5804]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5805]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5815]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5818]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5825]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5809]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5826]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5819]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5821]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 18:25:30 berlin crond[5816]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 19:50 delayed into subsequent minute 19:52. Skipping job run.
 Sep 19 19:52:48 berlin crond[19429]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 19:58 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:56 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:05 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:08 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:52 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:55 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:08 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:03 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:07 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:01 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:59 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:49 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:48 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:54 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:53 delayed into subsequent minute 20:09. Skipping job run.
 error: Job execution of per-minute job scheduled for 19:51 delayed into subsequent minute 20:09. Skipping job run.
 Sep 19 20:09:03 berlin crond[19450]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19449]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19462]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19464]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19434]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19445]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19458]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19461]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19460]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19454]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19455]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19425]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19420]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19443]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19440]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 20:09:03 berlin crond[19430]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 20:42 delayed into subsequent minute 20:45. Skipping job run.
 Sep 19 20:46:09 berlin crond[15907]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 20:45 delayed into subsequent minute 20:50. Skipping job run.
 Sep 19 20:50:44 berlin crond[15918]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 20:43 delayed into subsequent minute 21:00. Skipping job run.
 Sep 19 21:00:26 berlin crond[15911]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 20:48 delayed into subsequent minute 21:00. Skipping job run.
 Sep 19 21:00:33 berlin crond[15928]: CRON (mgrastprod) ERROR: cannot set security context
 error: Job execution of per-minute job scheduled for 20:46 delayed into subsequent minute 21:00. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:44 delayed into subsequent minute 21:00. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:50 delayed into subsequent minute 21:00. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:53 delayed into subsequent minute 21:00. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:49 delayed into subsequent minute 21:00. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:47 delayed into subsequent minute 21:00. Skipping job run.
 error: Job execution of per-minute job scheduled for 20:53 delayed into subsequent minute 21:00. Skipping job run.
 Sep 19 21:00:33 berlin crond[15922]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 21:00:33 berlin crond[15913]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 21:00:33 berlin crond[15932]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 21:00:33 berlin crond[15935]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 21:00:33 berlin crond[15930]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 21:00:33 berlin crond[15924]: CRON (mgrastprod) ERROR: cannot set security context
 Sep 19 21:00:33 berlin crond[15934]: CRON (mgrastprod) ERROR: cannot set security context

 ---------------------- Cron End ------------------------- 

 --------------------- httpd Begin ------------------------ 

 Requests with error response codes
    404 Not Found
       /.cobalt: 1 Time(s)
       /ControlManager/default.htm: 1 Time(s)
       /F8h_gaPE2FMa.asp: 1 Time(s)
       /F8h_gaPE2FMa.cfm: 1 Time(s)
       /F8h_gaPE2FMa.cgi: 1 Time(s)
       /F8h_gaPE2FMa.html: 1 Time(s)
       /F8h_gaPE2FMa.inc: 1 Time(s)
       /F8h_gaPE2FMa.php: 1 Time(s)
       /F8h_gaPE2FMa.php3: 1 Time(s)
       /F8h_gaPE2FMa.pl: 1 Time(s)
       /F8h_gaPE2FMa.sh: 1 Time(s)
       /F8h_gaPE2FMa.shtml: 1 Time(s)
       /MSWSMTP/Common/Authentication/Logon.aspx: 1 Time(s)
       /admin.back: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.asp: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.cfm: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.cgi: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.html: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.inc: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.php: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.php3: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.pl: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.sh: 1 Time(s)
       /cgi-bin/F8h_gaPE2FMa.shtml: 1 Time(s)
       /commoncgi/servlet/CCGIServlet?ApHost=PDT_ ... File=logout.htm: 1 Time(s)
       /file: 1 Time(s)
       /intruvert/jsp/admin/Login.jsp: 1 Time(s)
       /robots.txt: 1 Time(s)
       /scripts/F8h_gaPE2FMa.asp: 1 Time(s)
       /scripts/F8h_gaPE2FMa.cfm: 1 Time(s)
       /scripts/F8h_gaPE2FMa.cgi: 1 Time(s)
       /scripts/F8h_gaPE2FMa.html: 1 Time(s)
       /scripts/F8h_gaPE2FMa.inc: 1 Time(s)
       /scripts/F8h_gaPE2FMa.php: 1 Time(s)
       /scripts/F8h_gaPE2FMa.php3: 1 Time(s)
       /scripts/F8h_gaPE2FMa.pl: 1 Time(s)
       /scripts/F8h_gaPE2FMa.sh: 1 Time(s)
       /scripts/F8h_gaPE2FMa.shtml: 1 Time(s)
       /sdk: 1 Time(s)
       /sitemap.xml: 1 Time(s)
       /wavemaster.internal: 1 Time(s)
       /xmldata?item=All: 1 Time(s)
    501 Not Implemented
       /: 1 Time(s)

 ---------------------- httpd End ------------------------- 

 --------------------- Kernel Begin ------------------------ 

 WARNING:  Kernel Errors Present
     [<ffffffff8005dde9>] error_exit+0x0/0x84 ...:  7 Time(s)

 ---------------------- Kernel End ------------------------- 

 --------------------- pam_unix Begin ------------------------ 

 sshd:
    Authentication Failures:
       unknown (anlscan8.cspo.anl.gov): 2 Time(s)
    Invalid Users:
       Unknown Account: 2 Time(s)

 su:
    Sessions Opened:
       jbischof(uid=0) -> mgrastprod: 3 Time(s)

 sudo:
    Authentication Failures:
       jbischof(0) -> jbischof: 6 Time(s)
       dsouza(0) -> dsouza: 1 Time(s)

 ---------------------- pam_unix End ------------------------- 

 --------------------- postfix Begin ------------------------ 

 10423 bytes transferred
 11 messages sent
 11 messages removed from queue 
 ---------------------- postfix End ------------------------- 

 --------------------- SSHD Begin ------------------------ 

 Illegal users from:
    146.137.70.8 (anlscan8.cspo.anl.gov): 2 times

 Users logging in through sshd:
    dsouza:
       140.221.10.82 (dsouza.mcs.anl.gov): 1 time
    jbischof:
       140.221.11.19 (jbischof.mcs.anl.gov): 4 times

 Received disconnect:
    11: disconnected by user : 4 Time(s)

 **Unmatched Entries**
 pam_succeed_if(sshd:auth): error retrieving information about user Cisco : 1 time(s)
 pam_succeed_if(sshd:auth): error retrieving information about user cisco : 1 time(s)

 ---------------------- SSHD End ------------------------- 

 --------------------- Sudo (secure-log) Begin ------------------------ 

 ==============================================================================
 dsouza => root
 ------------------------------------------------------------------------------
 /bin/bash
 ==============================================================================
 jbischof => root
 ------------------------------------------------------------------------------
 /bin/zsh
 /bin/zsh
 /bin/zsh
 /bin/zsh
 /bin/zsh
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.up
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/api\.metagenomics\.up
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.up
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.up
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.up
 /bin/zsh
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.up
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.up
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.down
 /bin/zsh -c ssh root\@dunkirk\.mcs\.anl\.gov \
     \/homes\/jbischof\/MCP\/bin\/edit_nginx_config \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.conf \
     \/etc\/nginx\/conf\.d\/dev\.metagenomics\.up

 ---------------------- Sudo (secure-log) End ------------------------- 

 --------------------- Disk Space Begin ------------------------ 

 Filesystem            Size  Used Avail Use% Mounted on
 /dev/mapper/Vol0-LV00
                        15G   10G  3.5G  75% /
 /dev/md0               99M   39M   55M  42% /boot
 /dev/mapper/Vol0-local
                       1.8T  141G  1.7T   8% /local

 ---------------------- Disk Space End ------------------------- 

 ###################### Logwatch End #########################

[sysadmins] Logwatch for berlin.mcs.anl.gov (Linux)

logwatch＠mcs.anl.gov