weggli is a fast and robust semantic search tool for C and C++ codebases. It is designed to help security researchers identify interesting functionality in large codebases.

Related tags

Miscellaneous weggli
Overview

weggli

weggli example

Introduction

weggli is a fast and robust semantic search tool for C and C++ codebases. It is designed to help security researchers identify interesting functionality in large codebases.

weggli performs pattern matching on Abstract Syntax Trees based on user provided queries. Its query language resembles C and C++ code, making it easy to turn interesting code patterns into queries.

weggli is inspired by great tools like Semgrep, Coccinelle and CodeQL, but makes some different design decisions:

  • C++ support: weggli has first class support for modern C++ constructs, such as lambda expressions, range-based for loops and constexprs.

  • Minimal setup: weggli should work out-of-the box against most software you will encounter. weggli does not require the ability to build the software and can work with incomplete sources or missing dependencies.

  • Interactive: weggli is designed for interactive usage and fast query performance. Most of the time, a weggli query will be faster than a grep search. The goal is to enable an interactive workflow where quick switching between code review and query creation/improvement is possible.

  • Greedy: weggli's pattern matching is designed to find as many (useful) matches as possible for a specific query. While this increases the risk of false positives it simplifies query creation. For example, the query $x = 10; will match both assignment expressions (foo = 10;) and declarations (int bar = 10;).

Usage

Use -h for short descriptions and --help for more details.

Homepage: https://github.com/googleprojectzero/weggli

USAGE: weggli [OPTIONS] 
    
    
     

ARGS:
    
     
          
            A weggli search pattern. weggli's query language closely resembles
            C and C++ with a small number of extra features.
            
            For example, the pattern '{_ $buf[_]; memcpy($buf,_,_);}' will
            find all calls to memcpy that directly write into a stack buffer.
            
            Besides normal C and C++ constructs, weggli's query language
            supports the following features:
            
            _        Wildcard. Will match on any AST node. 
            
            $var     Variables. Can be used to write queries that are independent
                     of identifiers. Variables match on identifiers, types,
                     field names or namespaces. The --unique option
                     optionally enforces that $x != $y != $z. The --regex option can
                     enforce that the variable has to match (or not match) a
                     regular expression.
            
            _(..)    Subexpressions. The _(..) wildcard matches on arbitrary
                     sub expressions. This can be helpful if you are looking for some
                     operation involving a variable, but don't know more about it.
                     For example, _(test) will match on expressions like test+10,
                     buf[test->size] or f(g(&test));
            
            not:     Negative sub queries. Only show results that do not match the
                     following sub query. For example, '{not: $fv==NULL; not: $fv!=NULL *$v;}'
                     would find pointer dereferences that are not preceded by a NULL check.
            
            weggli automatically unwraps expression statements in the query source 
            to search for the inner expression instead. This means that the query `{func($x);}` 
            will match on `func(a);`, but also on `if (func(a)) {..}` or  `return func(a)`. 
            Matching on `func(a)` will also match on `func(a,b,c)` or `func(z,a)`. 
            Similarly, `void func($t $param)` will also match function definitions 
            with multiple parameters. 
            
            Additional patterns can be specified using the --pattern (-p) option. This makes
            it possible to search across functions or type definitions.
    
      
              
            Input directory or file to search. By default, weggli will search inside 
            .c and .h files for the default C mode or .cc, .cpp, .cxx, .h and .hpp files when
            executing in C++ mode (using the --cpp option).
            Alternative file endings can be specified using the --extensions (-e) option.
            
            When combining weggli with other tools or preprocessing steps, 
            files can also be specified via STDIN by setting the directory to '-' 
            and piping a list of filenames.

OPTIONS:
    -A, --after 
       
         Lines to print after a match. Default = 5. -B, --before 
        
          Lines to print before a match. Default = 5. -C, --color Force enable color output. -X, --cpp Enable C++ mode. --exclude 
         
          ... Exclude files that match the given regex. -e, --extensions 
          
           ... File extensions to include in the search. -f, --force Force a search even if the queries contains syntax errors. -h, --help Prints help information. --include 
           
            ... Only search files that match the given regex. -l, --limit Only show the first match in each function. -p, --pattern 
           
          
         
        
       
      
     
    
   

... Specify additional search patterns. -R, --regex ... Filter variable matches based on a regular expression. This feature uses the Rust regex crate, so most Perl-style regular expression features are supported. (see https://docs.rs/regex/1.5.4/regex/#syntax) Examples: Find calls to functions starting with the string 'mem': weggli -R 'func=^mem' '$func(_);' Find memcpy calls where the last argument is NOT named 'size': weggli -R 's!=^size$' 'memcpy(_,_,$s);' -u, --unique Enforce uniqueness of variable matches. By default, two variables such as $a and $b can match on identical values. For example, the query '$x=malloc($a); memcpy($x, _, $b);' would match on both void *buf = malloc(size); memcpy(buf, src, size); and void *buf = malloc(some_constant); memcpy(buf, src, size); Using the unique flag would filter out the first match as $a==$b. -v, --verbose Sets the level of verbosity. -V, --version Prints version information.

Examples

Calls to memcpy that write into a stack-buffer:

weggli '{
    _ $buf[_];
    memcpy($buf,_,_);
}' ./target/src

Potentially vulnerable snprintf() users:

weggli '{
    $ret = snprintf($b,_,_);
    $b[$ret] = _;
}' ./target/src

Potentially uninitialized pointers:

weggli '{ _* $p;
NOT: $p = _;
$func(&$p);
}' ./target/src

Potentially insecure WeakPtr usage:

weggli -X '{
$x = _.GetWeakPtr(); 
DCHECK($x); 
$x->_;}' ./target/src

Debug only iterator validation:

weggli -X 'DCHECK(_!=_.end());' ./target/src

Functions that perform writes into a stack-buffer based on a function argument.

weggli '_ $fn(_ $limit) {
    _ $buf[_];
    for (_; $i<$limit; _) {
        $buf[$i]=_;
    }
}' ./target/src

Functions with the string decode in their name

weggli -R func=decode '_ $func(_) {_;}'

Encoding/Conversion functions

weggli '_ $func($t *$input, $t2 *$output) {
    for (_($i);_;_) {
        $input[$i]=_($output);
    }
}' ./target/src

Build Instruction

# optional: install rust
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh 

git clone https://github.com/googleprojectzero/weggli.git
cd weggli; cargo build --release
./target/release/wegggli

Implementation details

Weggli is built on top of the tree-sitter parsing library and its C and C++ grammars. Search queries are first parsed using an extended version of the corresponding grammar, and the resulting AST is transformed into a set of tree-sitter queries in builder.rs. The actual query matching is implemented in query.rs, which is a relatively small wrapper around tree-sitter's query engine to add weggli specific features.

Contributing

See CONTRIBUTING.md for details.

License

Apache 2.0; see LICENSE for details.

Disclaimer

This project is not an official Google project. It is not supported by Google and Google specifically disclaims all warranties as to its quality, merchantability, or fitness for a particular purpose.

Comments
  • Matching constructor causes a crash

    Matching constructor causes a crash

    I have this code

    int getX() { return 0; }
    
    class Foo {
    	
    
    	Foo(int x, int y);
    
    	int getX();
    	int getY(){return m_y;};
    
    	int m_x;
    	int m_y;
    };
    
    int Foo::getX() const { return m_x; }
    
    Foo::Foo(int x, int y)
    	:m_x(x)
    	,m_y(y)
    	{}
    
    

    but when I do this query

    Foo::Foo(_){_;}
    

    I get the following crash

    thread '<unnamed>' panicked at 'begin <= end (166 <= 165) when slicing `
    int getX() { return 0; }
    
    class Foo {
    
    
            Foo(int x, int y);
    
            int getX();
            int getY(){return m_y;};
    
            int m_x;
            int m_y;
    };
    
    int Foo::getX() const { return m_x; }
    
    Foo::Foo(int x, int y)
            :m_x(x)
            ,m_y(y)
            {}
    `', /home/brad/.cargo/registry/src/github.com-1ecc6299db9ec823/weggli-0.2.3/src/result.rs:79:20
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    
    bug 
    opened by bradphelan 4
  • Unable to match class members

    Unable to match class members

    I have the following example

    int getX() { return 0; }
    
    class Foo {
    	
    
    	Foo(int x, int y)
    	:m_x(x)
    	,m_y(y)
    	{}
    
    	int getX();
    	int getY(){return m_y;};
    
    	int m_x;
    	int m_y;
    };
    
    int Foo::getX() const { return m_x; }
    

    I can match getX with

    _ Foo::getX() const {_;}
    

    but I can't create a query to match getY which is inline. Is this possible?

    opened by bradphelan 4
  • Improved Binary Ninja Script

    Improved Binary Ninja Script

    Rebased @mmaekr's script from #1 on current main, used the decompile to C API, and added some utility and interaction, demangling.

    Works rudimentally as both a plugin and a snippet in the Snippets editor.

    opened by fabianfreyer 4
  • Can't query across files?

    Can't query across files?

    test code:

    test1.cpp

    #include "test2.h"
    static INT64 func1(VOID)
    {
    
        lResult = func2(1, func3, (VOID *)NULL);
    
        return SUCCESS;
    }
    

    test2.cpp

    VOID *func3(VOID *pStr)
    {
        int i = 0;
        (VOID)pthread_detach(pthread_self());
    
        return (VOID *)0;
    } //lint !e715 !e818
    

    my query not work:

    weggli -C --cpp --unique 'func2(_,$fn,_);' -p '_ $fn(_){
    _;
    pthread_detach(pthread_self());
        }' test
    

    When I put it together, the query works. So is it my query worng or weggli not support query across files?

    opened by p1v07 4
  • How do I search for all else {} blocks that contain a return or a throw?

    How do I search for all else {} blocks that contain a return or a throw?

    First of all, thank you for sharing such a useful tool!

    I am trying to find patterns in the code like this:

      if (condition)
      {
          /* do */
          /* many */
          /* things */
      }
      else
      {
          throw PreconditionNotSatisified{};   // or return -ERROR, 
      }
    

    so they can be refactored to return early and reduce code indentation.

    I have tried:

      weggli 'if (_) else { throw }' .
    
      weggli 'if (_) { _ } else { throw $something; }' .
    

    but nothing seems to work. Help!

    Thank you.

    opened by 0x8000-0000 4
  • Mismatch of generic variable name using

    Mismatch of generic variable name using "NOT" statement

    Hello,

    While trying to generate a pattern for matching dangling pointer bugs on a random code-base I run into an issue. Explicitly writing the variable name ==> does result in a match. Using a generic variable name ($data) ==> does not result in a match.

    ie: Needle: {free($data); not: $data = NULL;} - doesnt match ==> expected behavior : MATCH Needle: {free(data); not: data = NULL;} - does match ==> expected behavior : MATCH

    Test file to reproduce the issue (only needle changed):

    #[test]
    fn not_dangling_correct() {
        let needle = "{free(data); not: data = NULL;}";
        let source = r"
        int32_t random_func_name2(random_struct **handle_ptr)
    {
        random_struct_data *data = NULL;
        random_struct *handle = NULL;
    
        if ((handle_ptr != NULL) && (*handle_ptr != NULL)) {
            handle = *handle_ptr;
            data = (random_struct_data*)handle->_data;
    
            if (data != NULL) {
                if (data->name != NULL) {
                   //TODO
                }
                free(data); //bug is here
            }
            if (handle != NULL) {
                free(handle);
            }
            *handle_ptr = NULL;
        }
    
        return 0;
    }";
    
        let matches = parse_and_match(needle, source);
    
        assert_eq!(matches, 1);
    }
    
    
    
    #[test]
    fn not_dangling_wrong() {
        let needle = "{free($data); not: $data = NULL;}";
        let source = r"
        int32_t random_func_name2(random_struct **handle_ptr)
    {
        random_struct_data *data = NULL;
        random_struct *handle = NULL;
    
        if ((handle_ptr != NULL) && (*handle_ptr != NULL)) {
            handle = *handle_ptr;
            data = (random_struct_data*)handle->_data;
    
            if (data != NULL) {
                if (data->name != NULL) {
                   //TODO
                }
                free(data);
            }
            if (handle != NULL) {
                free(handle);
            }
            *handle_ptr = NULL;
        }
    
        return 0;
    }";
    
        let matches = parse_and_match(needle, source);
    
        assert_eq!(matches, 1);
    }
    
    
    opened by AnisBoss 4
  • Added Binary Ninja script

    Added Binary Ninja script

    Hey, super cool tool! I saw this tweet and figured I would give it a shot :)

    I don't have IDA, but I tried to match the functionality the best I could based off the documentation.

    I am also totally new to Rust, so if you could provide some instructions on how to build the Python module so I could test the script, that would be appreciated.

    opened by mmaekr 4
  • Update vulnerable dependencies

    Update vulnerable dependencies

    Update dependencies identified by cargo-audit as potentially vulnerable.

    I don't think any of these impact weggli in any meaningful way, but I think it's nice to keep tools like cargo-audit happy so that if a genuine vulnerability shows up, it won't be hidden behind the noise of other irrelevant packages.

    I've tested these updates by running the unit tests and then by running weggli itself - I haven't tested the Python bindings.

    chrono: https://rustsec.org/advisories/RUSTSEC-2020-0159 nix: https://rustsec.org/advisories/RUSTSEC-2021-0119 regex: https://rustsec.org/advisories/RUSTSEC-2022-0013 time: https://rustsec.org/advisories/RUSTSEC-2020-0071

    opened by MatthewGentoo 3
  • result: make captures public

    result: make captures public

    First of all, thanks for weggli!

    This is a small visibility change, making QueryResult.captures public instead of private. It's a handy field to have when using weggli's API.

    opened by woodruffw 3
  • Failure generating query without { }

    Failure generating query without { }

    Hi. This query generates an error with tree sitter: weggli '{ _ $x; for (_;_;_) $x = _; }' .

    Tree sitter query generation failed: Structure
                             (init_declarator declarator:(pointer_declarator declarator: [(identifier) (field_expression) (field_identifier) (scoped_identifier)] @2) value: [(cast_expression value: (_)) (_)])]) )
                            ^
    sexpr: ((declaration type:(_) declarator:[(identifier) (field_expression) (field_identifier) (scoped_identifier)] @0) )((for_statement "for" @1 initializer:(_) condition:(_) update:(_) [(assignment_expression left: [(identifier) (field_expression) (field_identifier) (scoped_identifier)] @2 right: [(cast_expression value: (_)) (_)])
                            (init_declarator declarator: [(identifier) (field_expression) (field_identifier) (scoped_identifier)] @2 value: [(cast_expression value: (_)) (_)])
                            (init_declarator declarator:(pointer_declarator declarator: [(identifier) (field_expression) (field_identifier) (scoped_identifier)] @2) value: [(cast_expression value: (_)) (_)])]) )
    This is a bug! Can't recover :/
    

    With {} it can generate the query. weggli '{ _ $x; for (_;_;_) {$x = _;} }' .

    This is not recognized,

    void main() {
            int i;
            for ( i;i;i ) i = 0;
    }
    

    while this one is recognized

    void main() {
            int i;
            for ( i;i;i ) {i = 0;}
    }
    

    Is the problem with the way tree sitter is used here? If it's with them, I'll forward this issue to them

    bug 
    opened by 82marbag 3
  • can't search for-statement which use class member variable as threshold

    can't search for-statement which use class member variable as threshold

    I tried to use weggli on hexray C output and found some useful cases recently.

    But I encounter a problem today and I think I need some help.

    the problem is, I tried to find some function like below:

    struct StructName *__fastcall ClassName::MethodName(ClassName *this, int a2)
    {
      __int64 i; // r8
      struct StructName *result; // rax
    
      for ( i = 0i64; i < this->dword_80; ++i )
      {
        result = *(this->qword_88 + 8 * i);
        if ( a2 == *(result + 112) )
          return result;
      }
    ..
    }
    

    I could found above function with query below:

    ./target/release/weggli --cpp 'for(_; _ < this->dword_80; _) { _; }' ~/hexray_output.cpp
    

    But, above query is using fixed member variable name so I couldn't exapand it to find another variant.

    I tried following queries but none of them working as I want.

    Queries with no-output

    ./target/release/weggli --cpp '_ $func(_* $thisptr) { for(_; _ < $thisptr->_; _) { _; } }' ~/hexray_output.cpp
    ./target/release/weggli --cpp '_ $func(_* $thisptr) { for(_; _ < $thisptr->dword_80; _) { _; } }' ~/hexray_output.cpp
    
    ./target/release/weggli -R 'thisptr=this|a1' --cpp '_ $func(_) { for(_; _ < $thisptr->dword_80; _) { _; } }' ~/hexray_output.cpp
    
    ./target/release/weggli --cpp '_ $func(_* $thisptr) { for(_; _ < _($thisptr)->_; _) { _; } }' ~/hexray_output.cpp
    
    

    Queries with output

    ./target/release/weggli --cpp '_ $func(_* $thisptr) { for(_; _ < _($thisptr); _) { _; } }' ~/hexray_output.cpp
    
    • Output example:
    __int64 __fastcall Func1(..., struct Struct1 *a2, ...)
    {
      int v4; // er14
      int v7; // eax
      int v8; // ebx
      int v9; // ebx
    
    // ...
        if ( v8 >= 0 )
        {
          if ( *(*(this + 932) + 112i64) )
          {
            for ( i = 0; i < *(a2 + 10); ++i ) // <- here
            {
             // ...
    
    __int64 __fastcall Func2(
            struct Struct2 *a1,
            ....)
    {
      __int64 v4; // rdi
    ...
    
      v4 = *(a1 + 5);
      v6 = a3;
      v7 = a2;
      updated = 0;
      for ( i = 0; i < *(*(a1 + 3) + 6i64); ++i ) // <- here
      {
        ...
    }
    
    

    only found i < (a1 + ...) , no output like i < a1->dword_80

    ./target/release/weggli -R 'thisptr=this|a1' --cpp '_ $func(_) { for(_; _ < _($thisptr); _) { _; } }' ~/hexray_output.cpp
    

    This one found i < a1->dword_80 and similar member variable reference. But as you can see, it just use regex match instead of using this argument of class method. I want to find data flow from this argument to for-loop.

    If you have any free time, I will really appreciate to let me know what I am doing wrong.


    FYI, my host OS is macOS BigSur.

    > sw_vers
    ProductName:	macOS
    ProductVersion:	11.4
    BuildVersion:	20F71
    
    opened by y0ny0ns0n 3
  • Feature request: JSON/YML multi-pattern input and result output

    Feature request: JSON/YML multi-pattern input and result output

    I'm quite new to Weggli, but as far as I can tell, it currently does not support providing input and output files. And each rule pattern check requires a separate execution of Weggli.

    For context - I've been playing around with Semgrep, which allows you to specify a patterns yml file with multiple patterns to check, and can output the findings to a .json files for easy parsing. Keen to hear thoughts, but it would be nice if Weggli could support something like this:

    Provide patterns.yml file containing multiple patterns like this:

      - id: double-free
        metadata:
          references:
            - https://cwe.mitre.org/data/definitions/415
            - https://github.com/struct/mms
            - https://www.sei.cmu.edu/downloads/sei-cert-c-coding-standard-2016-v01.pdf
            - https://docs.microsoft.com/en-us/cpp/sanitizers/asan-error-examples
            - https://dustri.org/b/playing-with-weggli.html
          confidence: MEDIUM
        message: >-
          The software calls free() twice on the same memory address,
          potentially leading to modification of unexpected memory locations.
        severity: ERROR
        languages:
          - c
          - cpp
        pattern: "{free($a); NOT: goto _; NOT: break; NOT: continue; NOT: $a = _; free($a);}" 
        extra_args:
          - "--unique"
      
      - id: uninit-pointers
       .....
    

    Run something like weggli --input /path/to/patterns.yml --output /path/to/results.json /path/to/codebase Where Weggli will run all patterns on a specified codebase (if possible), and e.g. generate a json output file which looks something like this:

    {
      "errors": []
      "results: [{
          "id": "double-free",
          "start": { "col": 10, "line": 42, "offset": 701 },
          "end": { "col": 25, "line": 42, "offset": 716 },
          "extra": {
            "fingerprint": "79965871385669e43",
            "is_ignored": false,
            "lines": "  ... 
                    int alloc_and_free2()
                    {
                        char *ptr = (char *)malloc(MEMSIZE);
                        free(ptr);
                        ptr = NULL;
                        free(ptr);
                    }
                    ....",
            "message": "The software calls free() twice on the same memory address, potentially leading to modification of unexpected memory locations.",
            "metadata": {
              "confidence": "HIGH",
              "references": [
                  - https://cwe.mitre.org/data/definitions/415
                  - https://github.com/struct/mms
                  - https://www.sei.cmu.edu/downloads/sei-cert-c-coding-standard-2016-v01.pdf
                  - https://docs.microsoft.com/en-us/cpp/sanitizers/asan-error-examples
                  - https://dustri.org/b/playing-with-weggli.html
              ]
            },
            "metavars": {},
            "severity": "ERROR"
          },
          "path": "test-data/sample_inputs/c-and-cpp/double-free.c"
       }]
    }
    

    Again - I know that Weggli doesn't support this kind of behavior atm and that it runs for each individual pattern (afaik, specifying additional patterns with -p is an "AND", rather than an "OR"). But just wanted to see if this is something that has been considered already?

    opened by LaurensBrinker 0
  • Add Binary ninja plugin to central community repo

    Add Binary ninja plugin to central community repo

    To get the binja plugin added to the plugin manager, we need to make a release and then open an issue in that repo as laid out here: https://github.com/Vector35/community-plugins#contributing-plugins

    opened by ZetaTwo 0
  • Feature request: cross function query and taint tracking

    Feature request: cross function query and taint tracking

    Hi, This is amazing tool! I have been able to find dozens of valid bugs in our production code with weggli for code review. It is very effective for simple pattern query. There is a major issue: weggli doesn't support cross function query and data tainting, which is very basic requirement for complex pattern search. For example: func1(int v) { in b = v; func2(b); }

    func2(int v) { memcpy(,,v); } in above code, if func1 is the attack surface, there is no way to track data flow, i.e., do data tainting, to track the value to the final memcpy. Simply query memcpy wont help since too many false positives. Not sure if tree-sitter supports this since data tracking usually needs to build the code, or is there any solution to partially support this?

    opened by huntcve 0
  • Python bindings fails with

    Python bindings fails with "undefined symbol"

    I seem to have some problems building the Python bindings on my Ubuntu 22.04 LTS setup. Running the Python test yields the output below. A similar error occurs if I do python3 setup.py install --user followed by python3 -c 'import weggli'. When another person tried it though it worked so it's not always. Might be something broken with my environment but posting it here for future reference and my debugging efforts.

    $ python3 setup.py test          
    running test
    WARNING: Testing via this command is deprecated and will be removed in a future version. Users looking for a generic test entry point independent of test runner are encouraged to use tox.
    running egg_info
    writing src/weggli.egg-info/PKG-INFO
    writing dependency_links to src/weggli.egg-info/dependency_links.txt
    writing top-level names to src/weggli.egg-info/top_level.txt
    reading manifest file 'src/weggli.egg-info/SOURCES.txt'
    adding license file 'LICENSE'
    writing manifest file 'src/weggli.egg-info/SOURCES.txt'
    running build_ext
    running build_rust
    cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml -v --features python pyo3/extension-module -- --crate-type cdylib
           Fresh autocfg v1.0.1
           Fresh unicode-xid v0.2.2
           Fresh cfg-if v1.0.0
       Compiling syn v1.0.85
       Compiling proc-macro-hack v0.5.19
         Running `rustc --crate-name build_script_build --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/syn-1.0.85/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debuginfo=2 --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' --cfg 'feature="visit"' -C metadata=5737202938caee8b -C extra-filename=-5737202938caee8b --out-dir /home/zetatwo/Projects/weggli/target/debug/build/syn-5737202938caee8b -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --cap-lints allow`
         Running `rustc --crate-name build_script_build --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro-hack-0.5.19/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debuginfo=2 -C metadata=f7ff84a8fe3d13fb -C extra-filename=-f7ff84a8fe3d13fb --out-dir /home/zetatwo/Projects/weggli/target/debug/build/proc-macro-hack-f7ff84a8fe3d13fb -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --cap-lints allow`
           Fresh scopeguard v1.1.0
           Fresh lazy_static v1.4.0
           Fresh cc v1.0.72
       Compiling parking_lot_core v0.8.5
         Running `rustc --crate-name build_script_build --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot_core-0.8.5/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debuginfo=2 -C metadata=f85214fee3e3ca60 -C extra-filename=-f85214fee3e3ca60 --out-dir /home/zetatwo/Projects/weggli/target/debug/build/parking_lot_core-f85214fee3e3ca60 -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --cap-lints allow`
       Compiling smallvec v1.7.0
         Running `rustc --crate-name smallvec --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/smallvec-1.7.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=9c17253beca91beb -C extra-filename=-9c17253beca91beb --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --cap-lints allow`
       Compiling unindent v0.1.7
         Running `rustc --crate-name unindent --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/unindent-0.1.7/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=95e9640e124853e7 -C extra-filename=-95e9640e124853e7 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --cap-lints allow`
       Compiling inventory v0.1.11
         Running `rustc --crate-name build_script_build --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/inventory-0.1.11/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debuginfo=2 -C metadata=4c250073ccd131b2 -C extra-filename=-4c250073ccd131b2 --out-dir /home/zetatwo/Projects/weggli/target/debug/build/inventory-4c250073ccd131b2 -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --cap-lints allow`
       Compiling pyo3 v0.13.2
         Running `rustc --crate-name build_script_build --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-0.13.2/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debuginfo=2 --cfg 'feature="auto-initialize"' --cfg 'feature="ctor"' --cfg 'feature="default"' --cfg 'feature="extension-module"' --cfg 'feature="indoc"' --cfg 'feature="inventory"' --cfg 'feature="macros"' --cfg 'feature="paste"' --cfg 'feature="pyo3-macros"' --cfg 'feature="unindent"' -C metadata=cb8ee8d4ec596434 -C extra-filename=-cb8ee8d4ec596434 --out-dir /home/zetatwo/Projects/weggli/target/debug/build/pyo3-cb8ee8d4ec596434 -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --cap-lints allow`
           Fresh unicode-width v0.1.9
           Fresh bitflags v1.3.2
           Fresh regex-syntax v0.6.25
           Fresh either v1.6.1
           Fresh vec_map v0.8.2
           Fresh cfg-if v0.1.10
           Fresh same-file v1.0.6
           Fresh ansi_term v0.12.1
           Fresh void v1.0.2
           Fresh termcolor v1.1.2
           Fresh strsim v0.8.0
           Fresh rustc-hash v1.1.0
       Compiling instant v0.1.12
         Running `rustc --crate-name instant --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/instant-0.1.12/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=dc0183b714626b1c -C extra-filename=-dc0183b714626b1c --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern cfg_if=/home/zetatwo/Projects/weggli/target/debug/deps/libcfg_if-fa0d38a03582caa4.rmeta --cap-lints allow`
         Running `/home/zetatwo/Projects/weggli/target/debug/build/syn-5737202938caee8b/build-script-build`
       Compiling lock_api v0.4.5
         Running `rustc --crate-name lock_api --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/lock_api-0.4.5/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=34b0c67f331fd2ed -C extra-filename=-34b0c67f331fd2ed --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern scopeguard=/home/zetatwo/Projects/weggli/target/debug/deps/libscopeguard-c988ee37a88938c5.rmeta --cap-lints allow`
       Compiling weggli v0.2.4 (/home/zetatwo/Projects/weggli)
         Running `rustc --crate-name build_script_build --edition=2018 build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debuginfo=2 --cfg 'feature="pyo3"' --cfg 'feature="python"' -C metadata=e9ac922e4610f015 -C extra-filename=-e9ac922e4610f015 --out-dir /home/zetatwo/Projects/weggli/target/debug/build/weggli-e9ac922e4610f015 -C incremental=/home/zetatwo/Projects/weggli/target/debug/incremental -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern cc=/home/zetatwo/Projects/weggli/target/debug/deps/libcc-619d115c76210738.rlib`
         Running `/home/zetatwo/Projects/weggli/target/debug/build/proc-macro-hack-f7ff84a8fe3d13fb/build-script-build`
         Running `/home/zetatwo/Projects/weggli/target/debug/build/parking_lot_core-f85214fee3e3ca60/build-script-build`
         Running `/home/zetatwo/Projects/weggli/target/debug/build/inventory-4c250073ccd131b2/build-script-build`
           Fresh textwrap v0.11.0
           Fresh walkdir v2.3.2
           Fresh libc v0.2.112
           Fresh proc-macro2 v1.0.36
           Fresh crossbeam-utils v0.8.6
           Fresh memchr v2.4.1
         Running `/home/zetatwo/Projects/weggli/target/debug/build/weggli-e9ac922e4610f015/build-script-build`
         Running `rustc --crate-name proc_macro_hack --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/proc-macro-hack-0.5.19/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debuginfo=2 -C metadata=36581dfd343e8acc -C extra-filename=-36581dfd343e8acc --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern proc_macro --cap-lints allow`
           Fresh log v0.4.14
           Fresh memoffset v0.6.5
           Fresh num-traits v0.2.14
           Fresh num_cpus v1.13.1
           Fresh atty v0.2.14
           Fresh time v0.1.44
         Running `rustc --crate-name parking_lot_core --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot_core-0.8.5/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=54209c3f614f7cef -C extra-filename=-54209c3f614f7cef --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern cfg_if=/home/zetatwo/Projects/weggli/target/debug/deps/libcfg_if-fa0d38a03582caa4.rmeta --extern instant=/home/zetatwo/Projects/weggli/target/debug/deps/libinstant-dc0183b714626b1c.rmeta --extern libc=/home/zetatwo/Projects/weggli/target/debug/deps/liblibc-07f81d1987f627ca.rmeta --extern smallvec=/home/zetatwo/Projects/weggli/target/debug/deps/libsmallvec-9c17253beca91beb.rmeta --cap-lints allow`
           Fresh nix v0.17.0
           Fresh quote v1.0.14
           Fresh crossbeam-channel v0.5.2
           Fresh aho-corasick v0.7.18
         Running `/home/zetatwo/Projects/weggli/target/debug/build/pyo3-cb8ee8d4ec596434/build-script-build`
       Compiling paste-impl v0.1.18
         Running `rustc --crate-name paste_impl --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/paste-impl-0.1.18/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debuginfo=2 -C metadata=175494bd18f9ac70 -C extra-filename=-175494bd18f9ac70 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern proc_macro_hack=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro_hack-36581dfd343e8acc.so --extern proc_macro --cap-lints allow`
           Fresh crossbeam-epoch v0.9.6
           Fresh num-integer v0.1.44
           Fresh clap v2.34.0
           Fresh colored v2.0.0
       Compiling parking_lot v0.11.2
         Running `rustc --crate-name parking_lot --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/parking_lot-0.11.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 --cfg 'feature="default"' -C metadata=0be689697a3bba97 -C extra-filename=-0be689697a3bba97 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern instant=/home/zetatwo/Projects/weggli/target/debug/deps/libinstant-dc0183b714626b1c.rmeta --extern lock_api=/home/zetatwo/Projects/weggli/target/debug/deps/liblock_api-34b0c67f331fd2ed.rmeta --extern parking_lot_core=/home/zetatwo/Projects/weggli/target/debug/deps/libparking_lot_core-54209c3f614f7cef.rmeta --cap-lints allow`
         Running `rustc --crate-name syn --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/syn-1.0.85/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' --cfg 'feature="visit"' -C metadata=13cf818070f8dc37 -C extra-filename=-13cf818070f8dc37 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern proc_macro2=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro2-389aadaa5c25aeea.rmeta --extern quote=/home/zetatwo/Projects/weggli/target/debug/deps/libquote-7e54fa6ad85adb38.rmeta --extern unicode_xid=/home/zetatwo/Projects/weggli/target/debug/deps/libunicode_xid-3f4caffb2e0bd218.rmeta --cap-lints allow --cfg syn_disable_nightly_tests`
           Fresh regex v1.5.4
           Fresh crossbeam-deque v0.8.1
           Fresh chrono v0.4.19
       Compiling paste v0.1.18
         Running `rustc --crate-name paste --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/paste-0.1.18/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=1ff2b4e07c7be25e -C extra-filename=-1ff2b4e07c7be25e --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern paste_impl=/home/zetatwo/Projects/weggli/target/debug/deps/libpaste_impl-175494bd18f9ac70.so --extern proc_macro_hack=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro_hack-36581dfd343e8acc.so --cap-lints allow`
           Fresh tree-sitter v0.20.2
           Fresh rayon-core v1.9.1
           Fresh simplelog v0.10.2
           Fresh rayon v1.5.1
       Compiling pyo3-macros-backend v0.13.2
         Running `rustc --crate-name pyo3_macros_backend --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-macros-backend-0.13.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=d9e312df010f9610 -C extra-filename=-d9e312df010f9610 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern proc_macro2=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro2-389aadaa5c25aeea.rmeta --extern quote=/home/zetatwo/Projects/weggli/target/debug/deps/libquote-7e54fa6ad85adb38.rmeta --extern syn=/home/zetatwo/Projects/weggli/target/debug/deps/libsyn-13cf818070f8dc37.rmeta --cap-lints allow`
       Compiling indoc-impl v0.3.6
       Compiling inventory-impl v0.1.11
         Running `rustc --crate-name indoc_impl --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/indoc-impl-0.3.6/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debuginfo=2 -C metadata=0826074e9c4ae085 -C extra-filename=-0826074e9c4ae085 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern proc_macro_hack=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro_hack-36581dfd343e8acc.so --extern proc_macro2=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro2-389aadaa5c25aeea.rlib --extern quote=/home/zetatwo/Projects/weggli/target/debug/deps/libquote-7e54fa6ad85adb38.rlib --extern syn=/home/zetatwo/Projects/weggli/target/debug/deps/libsyn-13cf818070f8dc37.rlib --extern unindent=/home/zetatwo/Projects/weggli/target/debug/deps/libunindent-95e9640e124853e7.rlib --extern proc_macro --cap-lints allow`
         Running `rustc --crate-name inventory_impl --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/inventory-impl-0.1.11/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debuginfo=2 -C metadata=a59475fd41b92be4 -C extra-filename=-a59475fd41b92be4 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern proc_macro2=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro2-389aadaa5c25aeea.rlib --extern quote=/home/zetatwo/Projects/weggli/target/debug/deps/libquote-7e54fa6ad85adb38.rlib --extern syn=/home/zetatwo/Projects/weggli/target/debug/deps/libsyn-13cf818070f8dc37.rlib --extern proc_macro --cap-lints allow`
       Compiling ctor v0.1.21
         Running `rustc --crate-name ctor --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/ctor-0.1.21/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debuginfo=2 -C metadata=fe9715a5eb5b39de -C extra-filename=-fe9715a5eb5b39de --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern quote=/home/zetatwo/Projects/weggli/target/debug/deps/libquote-7e54fa6ad85adb38.rlib --extern syn=/home/zetatwo/Projects/weggli/target/debug/deps/libsyn-13cf818070f8dc37.rlib --extern proc_macro --cap-lints allow`
       Compiling ghost v0.1.2
         Running `rustc --crate-name ghost --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/ghost-0.1.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debuginfo=2 -C metadata=04ae0cc4d2fd97fc -C extra-filename=-04ae0cc4d2fd97fc --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern proc_macro2=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro2-389aadaa5c25aeea.rlib --extern quote=/home/zetatwo/Projects/weggli/target/debug/deps/libquote-7e54fa6ad85adb38.rlib --extern syn=/home/zetatwo/Projects/weggli/target/debug/deps/libsyn-13cf818070f8dc37.rlib --extern proc_macro --cap-lints allow`
       Compiling pyo3-macros v0.13.2
         Running `rustc --crate-name pyo3_macros --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-macros-0.13.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debuginfo=2 -C metadata=d3adc766305a7f5f -C extra-filename=-d3adc766305a7f5f --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern pyo3_macros_backend=/home/zetatwo/Projects/weggli/target/debug/deps/libpyo3_macros_backend-d9e312df010f9610.rlib --extern quote=/home/zetatwo/Projects/weggli/target/debug/deps/libquote-7e54fa6ad85adb38.rlib --extern syn=/home/zetatwo/Projects/weggli/target/debug/deps/libsyn-13cf818070f8dc37.rlib --extern proc_macro --cap-lints allow`
       Compiling indoc v0.3.6
         Running `rustc --crate-name indoc --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/indoc-0.3.6/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=170156cc1a7b9c76 -C extra-filename=-170156cc1a7b9c76 --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern indoc_impl=/home/zetatwo/Projects/weggli/target/debug/deps/libindoc_impl-0826074e9c4ae085.so --extern proc_macro_hack=/home/zetatwo/Projects/weggli/target/debug/deps/libproc_macro_hack-36581dfd343e8acc.so --cap-lints allow`
         Running `rustc --crate-name inventory --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/inventory-0.1.11/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 -C metadata=966b134369e7408f -C extra-filename=-966b134369e7408f --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern ctor=/home/zetatwo/Projects/weggli/target/debug/deps/libctor-fe9715a5eb5b39de.so --extern ghost=/home/zetatwo/Projects/weggli/target/debug/deps/libghost-04ae0cc4d2fd97fc.so --extern inventory_impl=/home/zetatwo/Projects/weggli/target/debug/deps/libinventory_impl-a59475fd41b92be4.so --cap-lints allow`
         Running `rustc --crate-name pyo3 --edition=2018 /home/zetatwo/.cargo/registry/src/github.com-1ecc6299db9ec823/pyo3-0.13.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debuginfo=2 --cfg 'feature="auto-initialize"' --cfg 'feature="ctor"' --cfg 'feature="default"' --cfg 'feature="extension-module"' --cfg 'feature="indoc"' --cfg 'feature="inventory"' --cfg 'feature="macros"' --cfg 'feature="paste"' --cfg 'feature="pyo3-macros"' --cfg 'feature="unindent"' -C metadata=b62146b9735b1e6d -C extra-filename=-b62146b9735b1e6d --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern cfg_if=/home/zetatwo/Projects/weggli/target/debug/deps/libcfg_if-fa0d38a03582caa4.rmeta --extern ctor=/home/zetatwo/Projects/weggli/target/debug/deps/libctor-fe9715a5eb5b39de.so --extern indoc=/home/zetatwo/Projects/weggli/target/debug/deps/libindoc-170156cc1a7b9c76.rmeta --extern inventory=/home/zetatwo/Projects/weggli/target/debug/deps/libinventory-966b134369e7408f.rmeta --extern libc=/home/zetatwo/Projects/weggli/target/debug/deps/liblibc-07f81d1987f627ca.rmeta --extern parking_lot=/home/zetatwo/Projects/weggli/target/debug/deps/libparking_lot-0be689697a3bba97.rmeta --extern paste=/home/zetatwo/Projects/weggli/target/debug/deps/libpaste-1ff2b4e07c7be25e.rmeta --extern pyo3_macros=/home/zetatwo/Projects/weggli/target/debug/deps/libpyo3_macros-d3adc766305a7f5f.so --extern unindent=/home/zetatwo/Projects/weggli/target/debug/deps/libunindent-95e9640e124853e7.rmeta --cap-lints allow --cfg Py_SHARED --cfg Py_3_6 --cfg Py_3_7 --cfg Py_3_8 --cfg Py_3_9 --cfg Py_3_10 --cfg 'py_sys_config="WITH_THREAD"'`
         Running `rustc --crate-name weggli --edition=2018 src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type rlib --crate-type dylib --emit=dep-info,link -C embed-bitcode=no -C debuginfo=2 --crate-type cdylib --cfg 'feature="pyo3"' --cfg 'feature="python"' -C metadata=bac47e802d24988f --out-dir /home/zetatwo/Projects/weggli/target/debug/deps -C incremental=/home/zetatwo/Projects/weggli/target/debug/incremental -L dependency=/home/zetatwo/Projects/weggli/target/debug/deps --extern clap=/home/zetatwo/Projects/weggli/target/debug/deps/libclap-b3367e576e67dfe3.rlib --extern colored=/home/zetatwo/Projects/weggli/target/debug/deps/libcolored-28846ee9869253bc.rlib --extern log=/home/zetatwo/Projects/weggli/target/debug/deps/liblog-a402241ae309561f.rlib --extern nix=/home/zetatwo/Projects/weggli/target/debug/deps/libnix-2b057218735fb323.rlib --extern pyo3=/home/zetatwo/Projects/weggli/target/debug/deps/libpyo3-b62146b9735b1e6d.rlib --extern rayon=/home/zetatwo/Projects/weggli/target/debug/deps/librayon-4bd54a8f6a505307.rlib --extern regex=/home/zetatwo/Projects/weggli/target/debug/deps/libregex-4d86d90d817f153a.rlib --extern rustc_hash=/home/zetatwo/Projects/weggli/target/debug/deps/librustc_hash-062a375220cbcbba.rlib --extern simplelog=/home/zetatwo/Projects/weggli/target/debug/deps/libsimplelog-39cf1ecb22e7fbb2.rlib --extern tree_sitter=/home/zetatwo/Projects/weggli/target/debug/deps/libtree_sitter-c3e12a65db9ead5e.rlib --extern walkdir=/home/zetatwo/Projects/weggli/target/debug/deps/libwalkdir-78a2d3854b534f47.rlib -L native=/home/zetatwo/Projects/weggli/target/debug/build/weggli-2cc0bc4d0f1a0cf5/out -L native=/home/zetatwo/Projects/weggli/target/debug/build/weggli-2cc0bc4d0f1a0cf5/out -L native=/home/zetatwo/Projects/weggli/target/debug/build/weggli-2cc0bc4d0f1a0cf5/out -l static=tree-sitter-c -l static=tree-sitter-cpp-scanner -l stdc++ -l static=tree-sitter-cpp-parser -L native=/home/zetatwo/Projects/weggli/target/debug/build/tree-sitter-6cd8dc0e956750fc/out`
        Finished dev [unoptimized + debuginfo] target(s) in 19.17s
    Copying rust artifact from /home/zetatwo/Projects/weggli/target/debug/libweggli.so to /home/zetatwo/Projects/weggli/src/weggli.cpython-310-x86_64-linux-gnu.so
    tests (unittest.loader._FailedTest) ... ERROR
    
    ======================================================================
    ERROR: tests (unittest.loader._FailedTest)
    ----------------------------------------------------------------------
    ImportError: Failed to import test module: tests
    Traceback (most recent call last):
      File "/usr/lib/python3.10/unittest/loader.py", line 470, in _find_test_path
        package = self._get_module_from_name(name)
      File "/usr/lib/python3.10/unittest/loader.py", line 377, in _get_module_from_name
        __import__(name)
      File "/home/zetatwo/Projects/weggli/tests/__init__.py", line 2, in <module>
        import weggli
    ImportError: /home/zetatwo/Projects/weggli/src/weggli.cpython-310-x86_64-linux-gnu.so: undefined symbol: tree_sitter_cpp_external_scanner_create
    
    
    ----------------------------------------------------------------------
    Ran 1 test in 0.000s
    
    FAILED (errors=1)
    Test failed: <unittest.runner.TextTestResult run=1 errors=1 failures=0>
    error: Test failed: <unittest.runner.TextTestResult run=1 errors=1 failures=0>
    
    opened by ZetaTwo 2
  • Tree sitter query generation failed: Searching for multiple comparators fails

    Tree sitter query generation failed: Searching for multiple comparators fails

    I got an error where tree sitter query generation failed with weggli 0.2.4, and the cli kindly informed me this was a bug.

    Let me explain what I wanted to accomplish, what my query was, and the output.

    What I Wanted to Find, For Extra Context

    I want to find anywhere an enum value whose name ends with '_COUNT' is compared against some variable in order to find places an attacker can supply a negative enum value and dodge a bounds check.

    Here is some example vulnerable code:

    enum OptionType {
        Option_A,
        Option_B,
        Option_COUNT
    };
    
    bool OPTIONS[Option_Count];
    void set_option(enum OptionType option_type_attacker_controlled, bool set_to) {
        // If option_type_attacker_controlled is negative this check will pass leading to an oob write
        if (option_type_attacker_controlled >= Option_COUNT) { abort(); } 
        OPTIONS[option_type_attacker_controlled] = set_to;
    } 
    

    The Buggy Query

    Here is a minimal reproduction of a weggli query I came up with:

    % weggli --cpp -u -R '$counted=\w*_COUNT' -C '{($var >= $counted); OR: ($var > $counted); }' ./
    Tree sitter query generation failed: Structure
                     (binary_expression left: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @1 operator: "<=" right: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @0)]) )((labeled_statement label:(statement_identifier) (parenthesized_expression [(binary_expression left: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @2 operator: ">" right: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @3)
                                                                                                                                                                                                                                                                                                    ^
    sexpr: ((parenthesized_expression [(binary_expression left: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @0 operator: ">=" right: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @1)
                    (binary_expression left: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @1 operator: "<=" right: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @0)]) )((labeled_statement label:(statement_identifier) (parenthesized_expression [(binary_expression left: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @2 operator: ">" right: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @3)
                    (binary_expression left: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @3 operator: "<" right: [(identifier) (field_expression) (field_identifier) (qualified_identifier) (this)] @2)])) )
    This is a bug! Can't recover :/
    

    The Actual Query

    Here is the full query I wanted: weggli --cpp -u -R '$counted=\w*_COUNT' -C '{($var >= $counted); OR: ($var > $counted); OR: ($var < $counted); OR: ($var <= $counted); }' ./

    opened by iankronquist 0
Releases(v0.2.4)
  • v0.2.4(May 31, 2022)

    What's Changed

    • python: Fix missing argument from build_query_tree by @fabianfreyer in https://github.com/googleprojectzero/weggli/pull/30
    • python: Use setuptools to build python library by @fabianfreyer in https://github.com/googleprojectzero/weggli/pull/31
    • python: Add python files to gitignore by @fabianfreyer in https://github.com/googleprojectzero/weggli/pull/33
    • python: Add unit tests by @fabianfreyer in https://github.com/googleprojectzero/weggli/pull/34
    • Run tests on github actions by @fabianfreyer in https://github.com/googleprojectzero/weggli/pull/35
    • Python: Expose C++ argument to python bindings by @fabianfreyer in https://github.com/googleprojectzero/weggli/pull/36
    • ci: Improve github actions by @felixwilhelm in https://github.com/googleprojectzero/weggli/pull/41
    • result: make captures public by @woodruffw in https://github.com/googleprojectzero/weggli/pull/49

    New Contributors

    • @fabianfreyer made their first contribution in https://github.com/googleprojectzero/weggli/pull/30
    • @woodruffw made their first contribution in https://github.com/googleprojectzero/weggli/pull/49

    Full Changelog: https://github.com/googleprojectzero/weggli/compare/v0.2.3...v0.2.4

    Source code(tar.gz)
    Source code(zip)
  • v0.2.3(Nov 11, 2021)

  • v0.2.2(Oct 8, 2021)

    Changes since v0.2.1:

    • Support strict:
    • Improved matching for number literals
    • Better semantic matching for comparisons and commutative expressions.
    Source code(tar.gz)
    Source code(zip)
Owner
Google Project Zero
Projects by Google Project Zero
Google Project Zero
Typesense is a fast, typo-tolerant search engine for building delightful search experiences.

Fast, typo tolerant, fuzzy search engine for building delightful search experiences ⚡ ??

Typesense 12k Jan 2, 2023
OpenDCDiag is an open-source project designed to identify defects and bugs in CPUs.

OpenDCDiag is an open-source project designed to identify defects and bugs in CPUs. It consists of a set of tests built around a sophisticated CPU testing framework. OpenDCDiag is primarily intended for, but not limited to, Data Center CPUs.

OpenDCDiag 30 Dec 14, 2022
Unix pager (with very rich functionality) designed for work with tables. Designed for PostgreSQL, but MySQL is supported too. Works well with pgcli too. Can be used as CSV or TSV viewer too. It supports searching, selecting rows, columns, or block and export selected area to clipboard.

Unix pager (with very rich functionality) designed for work with tables. Designed for PostgreSQL, but MySQL is supported too. Works well with pgcli too. Can be used as CSV or TSV viewer too. It supports searching, selecting rows, columns, or block and export selected area to clipboard.

Pavel Stehule 1.9k Jan 4, 2023
RRxIO - Robust Radar Visual/Thermal Inertial Odometry: Robust and accurate state estimation even in challenging visual conditions.

RRxIO - Robust Radar Visual/Thermal Inertial Odometry RRxIO offers robust and accurate state estimation even in challenging visual conditions. RRxIO c

Christopher Doer 63 Dec 20, 2022
Identify I2C devices from a database of the most popular I2C sensors and other devices

I2C Detective Identify I2C devices from a database of the most popular I2C sensors and other devices. For more information see http://www.technoblogy.

David Johnson-Davies 21 Nov 29, 2022
An implementation of the SZZ algorithm, i.e., an approach to identify bug-introducing commits.

SZZ Unleashed SZZ Unleashed is an implementation of the SZZ algorithm, i.e. an approach to identify bug-introducing commits, introduced by Śliwerski e

Oscar Svensson 86 Nov 12, 2022
Gunyah is a Type-1 hypervisor designed for strong security, performance and modularity.

Gunyah is a Type-1 hypervisor, meaning that it is independent of any high-level OS kernel, and runs in a higher CPU privilege level. It does not depend on any lower-privileged OS kernel/code for its core functionality. This increases its security and can support a much smaller trusted computing base than a Type-2 hypervisor.

Qualcomm Innovation Center 84 Jan 2, 2023
Program your micro-controllers in a fast and robust high-level language.

Toit language implementation This repository contains the Toit language implementation. It is fully open source and consists of the compiler, virtual

Toit language 988 Jan 4, 2023
mimikatz is a tool I've made to learn C and make somes experiments with Windows security

mimikatz is a tool I've made to learn C and make somes experiments with Windows security

Benjamin DELPY 16.6k Dec 31, 2022
macOS Endpoint Security Message Analysis Tool

Endpoint Security Message Analysis Tool - esmat esmat is a command line tool for macOS that allows you to explore the behavior of Apple's Endpoint Sec

vast limits GmbH 35 Sep 27, 2022
Phage-Host Interaction Search Tool

PHIST Phage-Host Interaction Search Tool A tool to predict prokaryotic hosts for phage (meta)genomic sequences. PHIST links viruses to hosts based on

REFRESH Bioinformatics Group 19 Nov 25, 2022
Tool to search system for log4j-*.jar files

find_log4j Searches all disks for log4j-*.jar files and writes the matching paths to .txt in the same folder as the executable Description This comman

Brecht Sanders 3 Oct 30, 2022
C/C++ language server supporting multi-million line code base, powered by libclang. Emacs, Vim, VSCode, and others with language server protocol support. Cross references, completion, diagnostics, semantic highlighting and more

Archived cquery is no longer under development. clangd and ccls are both good replacements. cquery cquery is a highly-scalable, low-latency language s

Jacob Dufault 2.3k Jan 2, 2023
C/C++/ObjC language server supporting cross references, hierarchies, completion and semantic highlighting

ccls ccls, which originates from cquery, is a C/C++/Objective-C language server. code completion (with both signature help and snippets) definition/re

Fangrui Song 3.3k Jan 6, 2023
BAAF-Net - Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion (CVPR 2021)

Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusion (CVPR 2021) This repository is for BAAF-Net introduce

null 90 Dec 29, 2022
Semantic version library written in ANSI C

semver.c Semantic version v2.0 parser and render written in ANSI C with zero dependencies. Features Standard compliant (otherwise, open an issue) Vers

Tom 170 Nov 28, 2022
Semantic Edge Detection with Diverse Deep Supervision

Semantic Edge Detection with Diverse Deep Supervision This repository contains the code for our IJCV paper: "Semantic Edge Detection with Diverse Deep

Yun Liu 13 Oct 7, 2022
Semantic Versioning for modern C++

_____ _ _ / ____| | | (_) | (___ ___ _ __ ___ __ _ _ __ | |_ _ ___ \

Daniil Goncharov 211 Dec 20, 2022