113 Commits (d5ed28b065ec61d00205310f1be0c51bda5092ef)

Author	SHA1	Message	Date
Eric Leblond	5cec22ac37	threads: Add sanity check.	13 years ago
Victor Julien	1be65e7b68	Fixes for building in Cygwin.	14 years ago
Victor Julien	404868c28b	Get rid of strcasestr call as win32 doesn't have it.	14 years ago
Anoop Saldanha	d23e775ae2	fix threading bug. Main thread's restart TV code waiting on a failed TV. Now main thread sets the de_init flag before waiting on the failed thread. Thanks to Eric Leblond for reporting it	14 years ago
Anoop Saldanha	d68f182ebd	introduce SCPerfSyncCounters/SCPerfSyncCounters macro to synchronize counters	14 years ago
pilcrow	ed69eeab14	Safer macro parenthesization and do/while use	14 years ago
Victor Julien	1ab6443e44	Fix compilation when profiling is enabled.	14 years ago
Anoop Saldanha	7c729d2d53	some more code cleanup + comments added	14 years ago
Anoop Saldanha	3f1c4efceb	Add new flags var to tm module. TMs can now set flags to identify special properties. Also use these to identify receive TMs	14 years ago
Anoop Saldanha	54f6e4ff4d	Merge thread kill functions. Merge slot's tm_id with the one used by packet profiling. Remove some junk unused code from ms sync pts. Timeout setup cleanup as well. packet q dbg_maxlen now u32 var.	14 years ago
Anoop Saldanha	6c95526423	Introduce a new wrapper macro that wait loops till the flag(s) in question have been set	14 years ago
Anoop Saldanha	a7acf9ea8f	Remove all code introduced earlier concerned with ms sync points	14 years ago
Anoop Saldanha	b0a588beeb	Introduce another solution to solve stream timeout shutdown issue using thread flags. No more MSSyncPts	14 years ago
Anoop Saldanha	f2bcf9ea2c	modify post_pq packet handling. ... - Lock the q just once, once we have detected the presence of packet(s) in the queue. Unlock it when we consume all packets from the q.	14 years ago
Anoop Saldanha	9256c7bf0a	always keep queue locked till we exit flowprune. Should prevent potential threading issues	14 years ago
Anoop Saldanha	a559bfc165	signal the post pq if possible, whenever pseudo packets are injected into engine flow. Also carry out post pq processing irrespective of packet retrieval from the flow.	14 years ago
Anoop Saldanha	8363533a02	support for forced stream reassembly for to be pruned flows	14 years ago
Anoop Saldanha	15359dc47e	Slot structure now holds the TV it belongs to	14 years ago
Anoop Saldanha	c365bafbf6	We now inspect timed out streams + streams not processed as yet, at engine shutdown	14 years ago
Anoop Saldanha	56432cee16	Single thread kill also checks if inq is cleared before shutting down	14 years ago
Anoop Saldanha	8fa923c5ac	- All threads also check to see if their inq is cleared before they shutdown.	14 years ago
Anoop Saldanha	a844eecb0e	- Updated all runmodes to use synchronization points, right before each thread(slot function) tries to de-init the thread. - Main thread now first disables receive thread(s) before it kills receive and rest of the threads.	14 years ago
Anoop Saldanha	e567c2d002	Introduce master-slave synchronization support for ThreadVars	14 years ago
Anoop Saldanha	94c5ecb069	introduce inline function version of TmThreadsSlotProcessPkt macro. Retain the macro as well	14 years ago
Anoop Saldanha	3fb65f5ec2	fix local var usage for slot in tm-threads.c	14 years ago
Anoop Saldanha	acbcee69ff	support post pq packet processing in var slot	14 years ago
Victor Julien	baddfcaa1a	Extend packet profiling to other thread 'slot' functions.	14 years ago
Victor Julien	820b0ded82	Add per packet profiling. ... Per packet profiling uses tick based accounting. It has 2 outputs, a summary and a csv file that contains per packet stats. Stats per packet include: 1) total ticks spent 2) ticks spent per individual thread module 3) "threading overhead" which is simply calculated by subtracting (2) of (1). A number of changes were made to integrate the new code in a clean way: a number of generic enums are now placed in tm-threads-common.h so we can include them from any part of the engine. Code depends on --enable-profiling just like the rule profiling code. New yaml parameters: profiling: # packet profiling packets: # Profiling can be disabled here, but it will still have a # performance impact if compiled in. enabled: yes filename: packet_stats.log append: yes # per packet csv output csv: # Output can be disabled here, but it will still have a # performance impact if compiled in. enabled: no filename: packet_stats.csv Example output of summary stats: IP ver Proto cnt min max avg ------ ----- ------ ------ ---------- ------- IPv4 6 19436 11448 5404365 32993 IPv4 256 4 11511 49968 30575 Per Thread module stats: Thread Module IP ver Proto cnt min max avg ------------------------ ------ ----- ------ ------ ---------- ------- TMM_DECODEPCAPFILE IPv4 6 19434 1242 47889 1770 TMM_DETECT IPv4 6 19436 1107 137241 1504 TMM_ALERTFASTLOG IPv4 6 19436 90 1323 155 TMM_ALERTUNIFIED2ALERT IPv4 6 19436 108 1359 138 TMM_ALERTDEBUGLOG IPv4 6 19436 90 1134 154 TMM_LOGHTTPLOG IPv4 6 19436 414 5392089 7944 TMM_STREAMTCP IPv4 6 19434 828 1299159 19438 The proto 256 is a counter for handling of pseudo/tunnel packets. Example output of csv: pcap_cnt,ipver,ipproto,total,TMM_DECODENFQ,TMM_VERDICTNFQ,TMM_RECEIVENFQ,TMM_RECEIVEPCAP,TMM_RECEIVEPCAPFILE,TMM_DECODEPCAP,TMM_DECODEPCAPFILE,TMM_RECEIVEPFRING,TMM_DECODEPFRING,TMM_DETECT,TMM_ALERTFASTLOG,TMM_ALERTFASTLOG4,TMM_ALERTFASTLOG6,TMM_ALERTUNIFIEDLOG,TMM_ALERTUNIFIEDALERT,TMM_ALERTUNIFIED2ALERT,TMM_ALERTPRELUDE,TMM_ALERTDEBUGLOG,TMM_ALERTSYSLOG,TMM_LOGDROPLOG,TMM_ALERTSYSLOG4,TMM_ALERTSYSLOG6,TMM_RESPONDREJECT,TMM_LOGHTTPLOG,TMM_LOGHTTPLOG4,TMM_LOGHTTPLOG6,TMM_PCAPLOG,TMM_STREAMTCP,TMM_DECODEIPFW,TMM_VERDICTIPFW,TMM_RECEIVEIPFW,TMM_RECEIVEERFFILE,TMM_DECODEERFFILE,TMM_RECEIVEERFDAG,TMM_DECODEERFDAG,threading 1,4,6,172008,0,0,0,0,0,0,47889,0,0,48582,1323,0,0,0,0,1359,0,1134,0,0,0,0,0,8028,0,0,0,49356,0,0,0,0,0,0,0,14337 First line of the file contains labels. 2 example gnuplot scripts added to plot the data.	14 years ago
Eric Leblond	a8b21066df	tm-thread: fix documentation string	14 years ago
Victor Julien	7e1d911215	Small optimizations to pkt acq loop code.	14 years ago
Victor Julien	b753ecce50	Implement a pkt acq loop infra with support for pcap-file.	14 years ago
Anoop Saldanha	ff7284e7b7	Fix code that allows the engine to restart threads that have exited on failure	14 years ago
Anoop Saldanha	524af82b1a	code cleanup in tm-threads.c	14 years ago
Anoop Saldanha	4f7df1029d	Unify the use of slots to a single struct for threading API. Remove separate slot append functions for 1slot and varslot	14 years ago
Gerardo Iglesias Galvan	f545df3ea7	Fix potential issue in TmThreadsSlot1NoIn	14 years ago
Victor Julien	92ea1f68d4	Exit on thread restart limit reached.	14 years ago
Eric Leblond	4e9231266a	Compilation fix for OpenBSD and win32. ... This patch fixes compilation on OpenBSD platform. It is running fine on a pcap file. The patch should also fix compilation on WIN32 platform but this is not tested.	14 years ago
Pablo Rincon	35c168ab03	Fix CPU_* macros for Mac OS X	14 years ago
Eric Leblond	f9e453e14c	affinity: Use configured 'threads' value if set ... This patch modifies runmodes to make them use the new 'threads' variable. Signed-off-by: Eric Leblond <eric@regit.org>	14 years ago
Eric Leblond	789d46cc3c	Add per-cpu prio handling ... This patch updates affinity setting to add a support for per cpu priority setting. In exclusive mode a thread is dedicated to a CPU. This patch adds the ability to set the thread prio for all threads of a family running on a given CPU. With this patch we can write - detect_cpu_set: cpu: [ "all" ] mode: "exclusive" # run detect threads in these cpus low_prio: [ 0 ] medium_prio: [ "1-2" ] high_prio: [ 3 ] With this configuration, detect threads assigned to cpu 0 will have a low priority. Detect threads on cpus 1 and 2 will have prio medium... The previous configuration is equivalent to: - detect_cpu_set: cpu: [ "all" ] mode: "exclusive" # run detect threads in these cpus low_prio: [ 0 ] high_prio: [ 3 ] prio: "medium" because the prio value is used a default. Signed-off-by: Eric Leblond <eric@regit.org>	14 years ago
Eric Leblond	ea566d6601	Handle management thread with corresponding affinity ... This patch implement the setting of each management threads in the corresponding thread affinity. This is done by modifiying thread creation function. Signed-off-by: Eric Leblond <eric@regit.org>	14 years ago
Eric Leblond	0809deafc4	Implement function needed for affinity in tm-threads ... This patch features the implementation of affinity related changes in tm-threads. In place code has been used but some refactoring has been done to avoid code duplication. Signed-off-by: Eric Leblond <eric@regit.org>	14 years ago
Victor Julien	bfb6aac495	Sleep after checking for a thread flag in TmThreadWaitOnThreadInit now that the check is so much cheaper.	15 years ago
Victor Julien	9634389b9e	Fix TmThreadsUnsetFlag not unsetting flag if __sync_fetch_and_nand was used.	15 years ago
Pablo Rincon	fcff1ce7f4	Converting threadvar flags to atomic vars to avoid using the old spinlock	15 years ago
Anoop Saldanha	33f4beb0bc	batching of packets support for cuda b2g mpm. Supported for both 32 and 64 bit platforms	15 years ago
Victor Julien	1d74797b17	Attempt to work around NULL packets we're seeing ending up in queues when the compiler has optimized our code.	15 years ago
Victor Julien	37eb2290b0	Add some checks for 'impossible' conditions that become possible after enabling optimizations :-/	15 years ago
Victor Julien	ba12f3c109	Applayer to flow fixes and cleanups.	15 years ago
Victor Julien	3005297af2	Check for being properly setup before activating a thread. Fixes a potential although unlikely null-dereference.	15 years ago