102 Commits (a7acf9ea8fe0d3c9315713bed65c4e7059540f4f)

Author	SHA1	Message	Date
Anoop Saldanha	a7acf9ea8f	Remove all code introduced earlier concerned with ms sync points	14 years ago
Anoop Saldanha	b0a588beeb	Introduce another solution to solve stream timeout shutdown issue using thread flags. No more MSSyncPts	14 years ago
Anoop Saldanha	f2bcf9ea2c	modify post_pq packet handling. ... - Lock the q just once, once we have detected the presence of packet(s) in the queue. Unlock it when we consume all packets from the q.	14 years ago
Anoop Saldanha	9256c7bf0a	always keep queue locked till we exit flowprune. Should prevent potential threading issues	14 years ago
Anoop Saldanha	a559bfc165	signal the post pq if possible, whenever pseudo packets are injected into engine flow. Also carry out post pq processing irrespective of packet retrieval from the flow.	14 years ago
Anoop Saldanha	8363533a02	support for forced stream reassembly for to be pruned flows	14 years ago
Anoop Saldanha	15359dc47e	Slot structure now holds the TV it belongs to	14 years ago
Anoop Saldanha	c365bafbf6	We now inspect timed out streams + streams not processed as yet, at engine shutdown	14 years ago
Anoop Saldanha	56432cee16	Single thread kill also checks if inq is cleared before shutting down	14 years ago
Anoop Saldanha	8fa923c5ac	- All threads also check to see if their inq is cleared before they shutdown.	14 years ago
Anoop Saldanha	a844eecb0e	- Updated all runmodes to use synchronization points, right before each thread(slot function) tries to de-init the thread. - Main thread now first disables receive thread(s) before it kills receive and rest of the threads.	14 years ago
Anoop Saldanha	e567c2d002	Introduce master-slave synchronization support for ThreadVars	14 years ago
Anoop Saldanha	94c5ecb069	introduce inline function version of TmThreadsSlotProcessPkt macro. Retain the macro as well	14 years ago
Anoop Saldanha	3fb65f5ec2	fix local var usage for slot in tm-threads.c	14 years ago
Anoop Saldanha	acbcee69ff	support post pq packet processing in var slot	14 years ago
Victor Julien	baddfcaa1a	Extend packet profiling to other thread 'slot' functions.	14 years ago
Victor Julien	820b0ded82	Add per packet profiling. ... Per packet profiling uses tick based accounting. It has 2 outputs, a summary and a csv file that contains per packet stats. Stats per packet include: 1) total ticks spent 2) ticks spent per individual thread module 3) "threading overhead" which is simply calculated by subtracting (2) of (1). A number of changes were made to integrate the new code in a clean way: a number of generic enums are now placed in tm-threads-common.h so we can include them from any part of the engine. Code depends on --enable-profiling just like the rule profiling code. New yaml parameters: profiling: # packet profiling packets: # Profiling can be disabled here, but it will still have a # performance impact if compiled in. enabled: yes filename: packet_stats.log append: yes # per packet csv output csv: # Output can be disabled here, but it will still have a # performance impact if compiled in. enabled: no filename: packet_stats.csv Example output of summary stats: IP ver Proto cnt min max avg ------ ----- ------ ------ ---------- ------- IPv4 6 19436 11448 5404365 32993 IPv4 256 4 11511 49968 30575 Per Thread module stats: Thread Module IP ver Proto cnt min max avg ------------------------ ------ ----- ------ ------ ---------- ------- TMM_DECODEPCAPFILE IPv4 6 19434 1242 47889 1770 TMM_DETECT IPv4 6 19436 1107 137241 1504 TMM_ALERTFASTLOG IPv4 6 19436 90 1323 155 TMM_ALERTUNIFIED2ALERT IPv4 6 19436 108 1359 138 TMM_ALERTDEBUGLOG IPv4 6 19436 90 1134 154 TMM_LOGHTTPLOG IPv4 6 19436 414 5392089 7944 TMM_STREAMTCP IPv4 6 19434 828 1299159 19438 The proto 256 is a counter for handling of pseudo/tunnel packets. Example output of csv: pcap_cnt,ipver,ipproto,total,TMM_DECODENFQ,TMM_VERDICTNFQ,TMM_RECEIVENFQ,TMM_RECEIVEPCAP,TMM_RECEIVEPCAPFILE,TMM_DECODEPCAP,TMM_DECODEPCAPFILE,TMM_RECEIVEPFRING,TMM_DECODEPFRING,TMM_DETECT,TMM_ALERTFASTLOG,TMM_ALERTFASTLOG4,TMM_ALERTFASTLOG6,TMM_ALERTUNIFIEDLOG,TMM_ALERTUNIFIEDALERT,TMM_ALERTUNIFIED2ALERT,TMM_ALERTPRELUDE,TMM_ALERTDEBUGLOG,TMM_ALERTSYSLOG,TMM_LOGDROPLOG,TMM_ALERTSYSLOG4,TMM_ALERTSYSLOG6,TMM_RESPONDREJECT,TMM_LOGHTTPLOG,TMM_LOGHTTPLOG4,TMM_LOGHTTPLOG6,TMM_PCAPLOG,TMM_STREAMTCP,TMM_DECODEIPFW,TMM_VERDICTIPFW,TMM_RECEIVEIPFW,TMM_RECEIVEERFFILE,TMM_DECODEERFFILE,TMM_RECEIVEERFDAG,TMM_DECODEERFDAG,threading 1,4,6,172008,0,0,0,0,0,0,47889,0,0,48582,1323,0,0,0,0,1359,0,1134,0,0,0,0,0,8028,0,0,0,49356,0,0,0,0,0,0,0,14337 First line of the file contains labels. 2 example gnuplot scripts added to plot the data.	14 years ago
Eric Leblond	a8b21066df	tm-thread: fix documentation string	14 years ago
Victor Julien	7e1d911215	Small optimizations to pkt acq loop code.	14 years ago
Victor Julien	b753ecce50	Implement a pkt acq loop infra with support for pcap-file.	14 years ago
Anoop Saldanha	ff7284e7b7	Fix code that allows the engine to restart threads that have exited on failure	14 years ago
Anoop Saldanha	524af82b1a	code cleanup in tm-threads.c	14 years ago
Anoop Saldanha	4f7df1029d	Unify the use of slots to a single struct for threading API. Remove separate slot append functions for 1slot and varslot	14 years ago
Gerardo Iglesias Galvan	f545df3ea7	Fix potential issue in TmThreadsSlot1NoIn	15 years ago
Victor Julien	92ea1f68d4	Exit on thread restart limit reached.	15 years ago
Eric Leblond	4e9231266a	Compilation fix for OpenBSD and win32. ... This patch fixes compilation on OpenBSD platform. It is running fine on a pcap file. The patch should also fix compilation on WIN32 platform but this is not tested.	15 years ago
Pablo Rincon	35c168ab03	Fix CPU_* macros for Mac OS X	15 years ago
Eric Leblond	f9e453e14c	affinity: Use configured 'threads' value if set ... This patch modifies runmodes to make them use the new 'threads' variable. Signed-off-by: Eric Leblond <eric@regit.org>	15 years ago
Eric Leblond	789d46cc3c	Add per-cpu prio handling ... This patch updates affinity setting to add a support for per cpu priority setting. In exclusive mode a thread is dedicated to a CPU. This patch adds the ability to set the thread prio for all threads of a family running on a given CPU. With this patch we can write - detect_cpu_set: cpu: [ "all" ] mode: "exclusive" # run detect threads in these cpus low_prio: [ 0 ] medium_prio: [ "1-2" ] high_prio: [ 3 ] With this configuration, detect threads assigned to cpu 0 will have a low priority. Detect threads on cpus 1 and 2 will have prio medium... The previous configuration is equivalent to: - detect_cpu_set: cpu: [ "all" ] mode: "exclusive" # run detect threads in these cpus low_prio: [ 0 ] high_prio: [ 3 ] prio: "medium" because the prio value is used a default. Signed-off-by: Eric Leblond <eric@regit.org>	15 years ago
Eric Leblond	ea566d6601	Handle management thread with corresponding affinity ... This patch implement the setting of each management threads in the corresponding thread affinity. This is done by modifiying thread creation function. Signed-off-by: Eric Leblond <eric@regit.org>	15 years ago
Eric Leblond	0809deafc4	Implement function needed for affinity in tm-threads ... This patch features the implementation of affinity related changes in tm-threads. In place code has been used but some refactoring has been done to avoid code duplication. Signed-off-by: Eric Leblond <eric@regit.org>	15 years ago
Victor Julien	bfb6aac495	Sleep after checking for a thread flag in TmThreadWaitOnThreadInit now that the check is so much cheaper.	15 years ago
Victor Julien	9634389b9e	Fix TmThreadsUnsetFlag not unsetting flag if __sync_fetch_and_nand was used.	15 years ago
Pablo Rincon	fcff1ce7f4	Converting threadvar flags to atomic vars to avoid using the old spinlock	15 years ago
Anoop Saldanha	33f4beb0bc	batching of packets support for cuda b2g mpm. Supported for both 32 and 64 bit platforms	16 years ago
Victor Julien	1d74797b17	Attempt to work around NULL packets we're seeing ending up in queues when the compiler has optimized our code.	16 years ago
Victor Julien	37eb2290b0	Add some checks for 'impossible' conditions that become possible after enabling optimizations :-/	16 years ago
Victor Julien	ba12f3c109	Applayer to flow fixes and cleanups.	16 years ago
Victor Julien	3005297af2	Check for being properly setup before activating a thread. Fixes a potential although unlikely null-dereference.	16 years ago
Victor Julien	f80016530c	Remove unnecessary locking for thread-local packet-queues breaking on Win32.	16 years ago
Victor Julien	53acf08996	Add multi packet reading for pcap live mode. Add a partly lock free multi writer, multi reader ringbuffer.	16 years ago
Victor Julien	4e7df60b2f	Make pcap file mode read multiple packets per 'read'. Update threading model to deal with this.	16 years ago
Victor Julien	a48a767efc	Lockfree ringbuffer wip.	16 years ago
Gerardo Iglesias Galvan	9f4fae5b1a	Fix inconsistent use of dynamic memory allocation	16 years ago
Victor Julien	19584d0416	Fix tunneled and defrag reassembled packets with the new pending limits.	16 years ago
William Metcalf	ce01927515	Import of GPLv2 Header 050410	16 years ago
Victor Julien	070ed778b8	Libcap-ng support by Gurvinder Singh and myself. Basic support for per thread caps is added, but not activated as it doesn't seem to work yet. Work around for incompatibility between libnet 1.1 and libcap-ng added.	16 years ago
Victor Julien	23cb020493	Fix thread flag code to compile with gnu99	16 years ago
Victor Julien	63cb1818ed	Move TmThread*Flag functions to the header so they can be inline with gnu99 as well.	16 years ago
Victor Julien	79a780ffe4	Improve a number of error and info messages.	16 years ago