Commit Graph

813 Commits (681cfc95d53ced27e079439660bcb70f3d9fe75f)

Author SHA1 Message Date
Juliana Fajardini 681cfc95d5 flow/output: make exception policy logging optional
Task #7623
1 month ago
Juliana Fajardini 6186996ba7 flow/output: log triggered exception policies
To accompany the Exception Policy stats, also add information about any
Exception Policy triggered and for which target to the flow log event.

Task #6215

(cherry picked from commit 08e928988f)
1 month ago
Thomas Winter 316627e2f0 doc: Add upgrade note for ppp changes
(cherry picked from commit 0b2dfa2b68)
1 month ago
Juliana Fajardini 9bc1300a31 userguide/exceptions: clarify when stats are logged
The stats for exception policies are only logged/ present when any of
the exception policies are enabled (which means any value other than
"auto" or "ignore" in IDS mode, or "ignore" in IPS mode).

This wasn't clearly stated in the docs.

(cherry picked from commit a9b2a62ee4)
2 months ago
Juliana Fajardini 2f14b17f05 doc/exceptions: change stats counters names
As we've changed them for more search-friendly ones.

Related to
Task #7185

(cherry picked from commit d8c6a56a62)
2 months ago
Juliana Fajardini aa7c0c75f4 userguide: document exception policy stats
Configuration options and defaults, existing counters etc.

Related to
Task #5816

(cherry picked from commit 514e8b8b04)
2 months ago
Juliana Fajardini 19e007404e userguide: highlight exception policy effects
Some exception policies can only be applied to entire flows or
individual packets, for some exception scenarios. Make this easier to
read, in the documentation.

Related to
Task #5816

(cherry picked from commit 94b111283d)
2 months ago
Juliana Fajardini 6cb9a353ec decode/flow: add exception policy stats counters
We will register stats counters for all policies, even though for now
Suri only uses one possible configuration policy at a time. The idea is
that this could change in the near future, so we want to have this
ready.

Task #5816

(cherry picked from commit 657419b53e)
2 months ago
Juliana Fajardini 6c2996ab36 decode/ipv6: set packet flow in ip-in-ip
Based on cherry-picked commit, but adjusted to make changes optional.

Bug #7752

(cherry picked from commit fdf0fa30c6)
2 months ago
Juliana Fajardini 78ece1a7d1 decode: add stats counters for ipv4/ipv6 over ipv4
These existed for ipv6 over ipv6, and ipv4 over ipv6, but not for the
ipv4 counterpart.

Task #7758

(backported from cbe621fb09)
2 months ago
Juliana Fajardini 9939e29f6e decode/ipv4: add missing ip-in-ip case handling
A flow with IPv4 IP in IP traffic won't handle this tunneling case
properly.
This leads to potential malicious traffic not triggering alerts, as well
as other inaccuracies in the logs.

Bug #7725

(cherry-picked from commit e3e24cfb3d)
2 months ago
Juliana Fajardini c02d73f216 docs/exceptions: minor improvements
Add section label and doc reference, add another term to Common terms
section.

Tried to also improve readability for the Midstream behavior tables:
- Highlight key-words when differences are only in `do` vs `no`.
- Change order of sentences in certain descriptions, to align with the
  steps those happen for the engine.

(cherry picked from commit 95560f0966)
2 months ago
Juliana Fajardini c5269e2c26 doc/exceptions: standardize page section markdown
Following the discussion on #7396, use those symbols for to keep the
standard.
Remove the repeting `Exception Policies` section header, too.

Related to
Task #7396

(cherry picked from commit e5c1e5f792)
2 months ago
Juliana Fajardini de5d6df321 doc/exceptions: clarify ambiguous terminology
The terms 'inspection' and 'detection' were being used to signify
different engine actions in this document, while throughout the
documentation and code they're many times interchangeable.

Replace 'inspection' with 'parsing' or even 'decoding and parsing' as
more appropriate.

Add a small glossary to clarify what we mean with those terms.

(cherry picked from commit 0256ce51eb)
2 months ago
Philippe Antoine 7a702031a6 doc: document krb5 event type
Ticket: 6566
(cherry picked from commit 4d4eb84eca)
3 months ago
Philippe Antoine 9fc24564e9 doc: do not have bittorrent in the middle of SMB events
(cherry picked from commit f907216e1a)
3 months ago
Lukas Sismis fce8336c93 pcap-file: document capture method options
(cherry picked from commit eb52e337da)
4 months ago
Lukas Sismis 96b3bc4d9b doc: update available options in the example config
(cherry picked from commit e780a20f82)
4 months ago
Juliana Fajardini f6140df708 upgrade: list inspection recursion default limit
As the yaml indicated before that if no value was specified there were
no limits, and now there will be one.

(cherry picked from commit 3985b24e1b)
7 months ago
Victor Julien d86c5f9f0c datasets: set higher hashsize limits
To avoid possible upgrade issues, allow higher defaults than in the
master branch. Add some upgrade guidance and a note that defaults will
probably be further reduced.
7 months ago
Jason Ish fc6022286c doc/userguide: af-packet upgrade notes
Add note about increased block size and how to change it back to old
defaults if needed.

Ticket: #7458
(cherry picked from commit c6d18fc871)
7 months ago
Philippe Antoine bab716776b detect: limit base64_decode `bytes` to 64KiB
Ticket: 7613

Avoids potential large per-thread memory allocation. A buffer with the
size of the largest decode_base64 buffer size setting would be allocated
per thread. As this was a u32, it could mean a per-thread 4GiB memory
allocation.

64KiB was already the built-in default for cases where bytes size wasn't
specified.

(cherry picked from commit 32d0bd2bbb)
7 months ago
Jeff Lucovsky d56c078193 doc/csum: Stream checksum validation change
Describe the change of behavior between the stream.checksum-validation
setting and checksum-based rule keywords.

(cherry picked from commit cfbf8fda94)
8 months ago
Victor Julien 55b4c1e6fd stream: mark urgent experimental; set safe defaults
Uncomment in default config. This will make the policy "inline",
which is the same behavior as prior to the urgent policy support.

Add line to docs that this is an experimental feature.
10 months ago
Victor Julien faf2613281 doc/userguide: document TCP urgent policy
(cherry picked from commit d11e8a8ee7)
10 months ago
Philippe Antoine a578b0919f doc: improve documentation about guess-applayer-tx
Ticket: 7199
10 months ago
Philippe Antoine 19a638611b detect: log app-layer metadata in alert with single tx
Ticket: 7199

Uses a config parameter detect.guess-applayer-tx to enable
this behavior (off by default)

This feature is requested for use cases with signatures not
using app-layer keywords but still targetting application
layer transactions, such as pass/drop rule combination,
or lua usage.

This overrides the previous behavior of checking if the signature
has a content match, by checking if there is only one live
transaction, in addition to the config parameter being set.

(cherry picked from commit f2c3776314)
10 months ago
Juliana Fajardini cbc0aa57b1 flowint: add isnotset support
Similar keywords use `isnotset`, while `flowint` only accepted `notset`
Opted to change the code, not only the regex, to keep the underlying
code also following the same patterns.

Task #7426

(cherry picked from commit 6e4a501e7c)
11 months ago
Jason Ish ccc61f6294 requires: add option to ignore unknown requirements
The new behavior in 8, and backported is to treat unknown requirements
as unsatisfied requirements.

For 7.0.8, add a configuration option, "ignore-unknown-requirements"
to completely ignore unknown requirements, effectively treating them
as available.

Ticket: #7434
11 months ago
Jason Ish eac4854636 requires: treat unknown requires keywords as unmet requirements
For example, "requires: foo bar" is an unknown requirement, however
its not tracked, nor an error as it follows the syntax. Instead,
record these unknown keywords, and fail the requirements check if any
are present.

A future version of Suricata may have new requires keywords, for
example a check for keywords.

Ticket: #7418
(cherry picked from commit 820a3e51b7)
11 months ago
Philippe Antoine ca8bf6e64c http: have a headers limit
Ticket: 7191

So as to avoid quadratic complexity in libhtp.
Make the limit configurable from suricata.yaml,
and have an event when network traffic goes over the limit.

(cherry picked from commit bb714c9178)
1 year ago
Philippe Antoine 72456d359b detect/datasets: implement unset command
Ticket: 7195

Otherwise, Suricata aborted on such a rule

(cherry picked from commit e47598110a)
1 year ago
Sascha Steinbiss dc8cda6887 userguide: fix spelling of `security_result` EVE field
This ensures that the correct spelling of the `security_result` EVE
field for RFB (as opposed to `security-result`) is also reflected in the
documentation.

Ticket: #7210
(cherry picked from commit cb14e44780)
1 year ago
Victor Julien 32c8a7614d doc/userguide: update guidance on 5 to 6 upgrading
TCP memory use can be higher than expected in certain configs.

Ticket: #6552.
(cherry picked from commit 3456dea276)
1 year ago
Victor Julien 6824a4bc5f doc/userguide: document iprep isset/isnotset
(cherry picked from commit 8b42182fee)
1 year ago
Victor Julien b014b1e8e6 doc/userguide: add more operators to iprep
(cherry picked from commit 2f74d435d3)
1 year ago
Victor Julien e04d8f3045 doc/userguide: add noalert/alert keyword docs
(cherry picked from commit 50ef646d45)
1 year ago
Victor Julien 8fdbb0b17d doc/userguide: give pcre1 to pcre2 proper heading
(cherry picked from commit c83e3285ae)
1 year ago
Lukas Sismis 7cc86938fc doc: port user install and build instruction from master-6.0.x
Ticket: #6685
(cherry picked from commit bd9608771e)
1 year ago
Lukas Sismis 77997941ae doc: update eBPF compilation instructions
Ticket: #6599
(cherry picked from commit 521d1cb8e7)
1 year ago
Jeff Lucovsky ffca7658a2 output/ja4: Log ja4 hashes iff configured
This commit allows ja4 hashes to be logged iff enabled in the tls/quic
section of the outputs.

With the default setting ("off"), ja4 hashes will only be logged in
alerts when the signatures uses the ja4.hash keyword.

When enabled, ja4 hashes will be inclued in quic and tls logs.

- tls:
     ja4: on
- quic:
     ja4: on

Issue: 7010
1 year ago
Sascha Steinbiss 93fd349b3f ja4: implement for TLS and QUIC
Ticket: OISF#6379
(cherry picked from commit 120313f4da)
1 year ago
jason taylor 00c7473a00 doc: add source verification docs
Ticket: #6908

Signed-off-by: jason taylor <jtfas90@gmail.com>
(cherry picked from commit 47d6c3a3ab)
1 year ago
Victor Julien 84fc3bed2c detect/iprep: update doc about 0 value
A value of 0 was already allowed by the rule parser, but didn't
actually work.

Bug: #6834.
(cherry picked from commit fcca5c7514)
1 year ago
Shivani Bhardwaj f0b856214c doc: add note about fast_pattern w base64_data
Bug 6859
2 years ago
Jason Ish 363ca13a9c docs/userguide: use a consistent date for reproducible builds
By default, when Sphinx generates the man pages, the current date will
be embedded in them. This can be set to a specific date with the
"today" variable. Typically the date embedded in manpages in the
release date.

To achieve this, attempt to use the environment variable, RELEASE_DATE
to set the "today" variable, reverting back to the empty string if not
set. It is up to our build system to properly set this date.

Ticket: #6911
(cherry picked from commit 51bf1c3510)
2 years ago
Jason Ish 3b8ddf395a docs/conf.py: fix python escape warning
/home/jason/oisf/dev/suricata/master/doc/userguide/conf.py:74: SyntaxWarning: invalid escape sequence '\('
  "AC_INIT\(\[suricata\],\s*\[(.*)?\]\)",

(cherry picked from commit 4c16032f63)
2 years ago
Lukas Sismis ac67861fcf dpdk: add interrupt (power-saving) mode
When the packet load is low, Suricata can run in interrupt
mode. This more resembles the classic approach of processing
packets - CPU cores run low and only fetch packets
on interrupt.

Ticket: #6696
(cherry picked from commit 2a2898053c)
2 years ago
Juliana Fajardini 2efde5b87f userguide: fix explanation about bsize ranges
Our code handles Uint ranges as exclusive, but for bsize, our
documentation stated that they're inclusive.

Cf. from uint.rs:

    DetectUintMode::DetectUintModeRange => {
        if val > x.arg1 && val < x.arg2 {
            return true;
        }
    }

Task #6708

(cherry picked from commit 244a35d539)
2 years ago
Lukas Sismis 1814e81036 doc: mention the limited number of RX/TX descriptors on Intel NICs
Ticket: 6748
(cherry picked from commit 356f9ffa13)
2 years ago