parsing - Python script to extract new data from file since it was last read -



parsing - Python script to extract new data from file since it was last read -

i working on python script following:-

i read log file every 10 mins , on each read, extract added info file since lastly read (preferably without having read entire log file each time). example:-

at 09:00 read log file , content is:-

1. 2011-07-04 11:15:04,507 processing request 17897931 status 7 13 2. 2011-07-04 11:15:04,508 processing request 17897931 status 13 17 3. 2011-07-04 11:15:04,508 processing request d0fcb681 status 7 13 4. 2011-07-04 11:15:04,509 processing request d0fcb681 status 13 17 5. 2011-07-04 11:15:04,509 processing request 178819a1 status 7 13

at 09:10 read log file 1 time again , content is:-

1. 2011-07-04 11:15:04,507 processing request 17897931 status 7 13 2. 2011-07-04 11:15:04,508 processing request 17897931 status 13 17 3. 2011-07-04 11:15:04,508 processing request d0fcb681 status 7 13 4. 2011-07-04 11:15:04,509 processing request d0fcb681 status 13 17 5. 2011-07-04 11:15:04,509 processing request 178819a1 status 7 13 6. 2011-07-04 11:15:04,510 processing request 178819a1 status 13 17 7. 2011-07-04 11:15:04,510 processing request 17161df1 status 7 13 8. 2011-07-04 11:15:04,511 processing request 17161df1 status 13 17 9. 2011-07-04 11:15:04,511 processing request 182013e1 status 7 9

how can script extract new lines (lines 6. 9.)?

i have shell script doing task using file's inode. looking solution based on python.

my plan execute script via crontab.

do guys have thought how can done?

check size of file wait until size changes open file, seek previous size read

example:

import os, time size = os.stat(file).st_size time.sleep(600) fh = open(file) fh.seek(size) newdata = fh.read()

this illustration will, time time, read partial line if process writing log @ same time. i'll leave solution exercise :)

python parsing extraction

Comments

Post a Comment

Popular posts from this blog

iphone - Dismissing a UIAlertView -

iphone - Dismissing a UIAlertView - i set in app purchase app, , when user taps button, purchase started. basically, tap button, , depending on speed on net connection, waiting 10 seconds until new alert view comes asking if purchase product. user tap button multiple times since nil came up, , multiple purchase alert views come up. additionally, maybe seen user app bug. in end, problem. i want alert view come spinning wheel says "loading..." when users taps purchase button. problem is, how dismiss when new alert view comes asking user if want purchase product? if ([uialertview alloc] says: @"whatever apple's alert view says") { //dismiss "loading..." alert view here } i uncertainty work, input appreciated. thanks! you need have access alertview. can this. create alertview instance var in app delegate , when want show loading initialize instance var assign property , when want dismiss phone call [alertviewinstance d...
Read more

intellij idea - Update external libraries with intelij and java -

intellij idea - Update external libraries with intelij and java - simple plenty really. i'm using apache jars, i'll create changes jar's every often. these jars listed external libs in intelij (i.e classpath looking install dir of jar's). when create changes intelij doesn't seem know new implementation. have remove jar external library , re-ad it. does know have intelij picks changes automatically ? i've done clean , rebuild project had little effect. you can go preferences -> build, execution, deployment -> build tools -> maven -> importing , check box says import maven projects automatically . in mac, can command + shift + a , come in action reimport , click on reimport maven projects . intellij-idea
Read more

javascript - send data from a new window to previous window in php -

javascript - send data from a new window to previous window in php - i have image in main.php file : <img src="..\images\image.gif" class="cur" onclick="imgwin();"> when click on image below function has called : function imgwin() { imagewin=window.open("../pages/img.php","imagewin","toolbar=no,width=500,height=200,directories=no,menubar=no,scrollbars=yes"); } this function opens img.php in new window img.php file : <html> <head> <title>upload image</title> </head> <body> <form name="imgform" method="get" action="#"> address : <input type="file" name="imgurl" size="50"> description : <input type="text" name="description" size="50"> <input type="submit" value="sumbit...
Read more