Metadata-Version: 2.1
Name: split-layer
Version: 0.0.10
Summary: Print each layer forward and backward time of PyTorch models, ref: https://discuss.pytorch.org/t/how-to-split-backward-process-wrt-each-layer-of-neural-network/7190
Home-page: UNKNOWN
Author: swordfate
Author-email: 1317732065@qq.com
License: UNKNOWN
Description: # Split\_layer
        This is a simple package to print each layer forward and backward time of PyTorch models.
        
        
        ## Usage
        
        You can use this tool by three steps:
        
        0. Install split_layer by running `pip3 install split_layer -U --user`
        
        1. Find the file which defines the structure of a Network. Add the following code:
        
        from split_layer import split_layer_dec
        
        @split_layer_dec(__file__)
        class Net():
        
        **Notice:** Make sure the forward function input parameter and itermediate output should be `x`. For example:
        x = F.relu(self.conv1(x))
        return x
        
        
        2. Replace `loss.backward()` with something like `net.backward(outputs)`. The you can run your training code as usual.
        
        
        
        ## Others
        It is built according to the accepted answer of this [question](https://discuss.pytorch.org/t/how-to-split-backward-process-wrt-each-layer-of-neural-network/7190'). Now, it is not flexible enough, and **DO NOT support DP or DDP models**. We will develop it further in the future.
        
        ## Requirements
        Make sure `inspect` and `torch` has been installed.
        
Platform: UNKNOWN
Description-Content-Type: text/markdown
