Tag Archives: Python

During my work, I need to parse the result from some huge log files. The result is always save at the end of the file. So I need find a way to get the required last lines to accelerate the parse speed. Here is the function I have written to achieve this requirement in python.

Get the last lines from a text file

def last_lines(filename, lines=1):
    '''
    return the last lines from the specify files
    '''
    with open(filename, 'rb') as fh:
        fh.seek(0, os.SEEK_END)
        if fh.tell() == 0:
            return []
        fh.seek(-2, os.SEEK_END)
        #while not BOF
        while fh.tell() > 0:
            cur_char = fh.read(1).decode()
            if cur_char == '\n':
                lines -= 1
            if lines > 0:
                fh.seek(-2, os.SEEK_CUR)
            else:
                break
        return [line.decode() for line in fh.readlines()]

Use Python puka client with RabbitMQ

Leave a reply

Send a message to RabbitMQ

Get the last lines from a text file

#!/usr/bin/env python
 
import sys
sys.path.append("..")
 
 
import puka
 
client = puka.Client("amqp://localhost/")
 
promise = client.connect()
client.wait(promise)
 
promise = client.queue_declare(queue='test')
client.wait(promise)
 
promise = client.basic_publish(exchange='', routing_key='test',
                              body="Hello world!")
client.wait(promise)
 
print " [*] Message sent"
 
promise = client.queue_declare(queue='test', passive=True)
print " [*] Queue size:", client.wait(promise)['message_count']
 
promise = client.close()
client.wait(promise)

Erxin, Shang(Edwin, 尚尔鑫)'s Home Page

Knowledge should be free.

Tag Archives: Python

Python基础教程，第一章简介（Python Fundamental, Charpter 01 Introduction)

Get required lasts lines from a huge text file in python

Use Python puka client with RabbitMQ