- [NVIDIA Visual Profiler | NVIDIA Developer](https://developer.nvidia.com/nvidia-visual-profiler) - [Performance Analysis Tools | NVIDIA Developer](https://developer.nvidia.com/performance-analysis-tools) - [1. Preparing An Application For Profiling — Profiler 12.3 documentation](https://docs.nvidia.com/cuda/profiler-users-guide/index.html) - [CUDA Profiling Tools Interface | NVIDIA Developer](https://developer.nvidia.com/cuda-profiling-tools-interface) - [Profiler](https://docs.nvidia.com/cuda/pdf/CUDA_Profiler_Users_Guide.pdf) - [Tag: Profiling | NVIDIA Technical Blog](https://developer.nvidia.com/blog/tag/profiling/) - [Kernel Profiling Guide :: Nsight Compute Documentation](https://docs.nvidia.com/nsight-compute/ProfilingGuide/index.html) - [CUDA Tools - Tools for Profiling and Debugging](https://events.prace-ri.eu/event/978/sessions/3044/attachments/1136/1863/profiling.pdf) - [Releases · JeremyMain/GPUProfiler](https://github.com/JeremyMain/GPUProfiler/releases) - [Profiling Deep Learning Applications with NVIDIA NSight - YouTube](https://www.youtube.com/watch?v=K27rLXkOiqo) - [Profiling GPU codes with Nsight - YouTube](https://www.youtube.com/watch?v=51K5EqGqzCM) - [Running CUDA Profilers on Linux: GPU Optimizations](https://codingbyexample.com/2020/09/25/cuda-profiling-linux/) - [GPU Profiler – NVIDIA Community Tool – Virtually Visual](https://virtuallyvisual.wordpress.com/2016/06/08/gpu-profiler-nvidia-community-tool-and-source-code/) - [eBPF: User-Defined Codes in Kernel - Guochao Xie](https://xieguochao.com/blog/programming/ebpf) [GPU Profiling with BPF at Meta - Riham Selim - YouTube](https://www.youtube.com/watch?v=5xAghByteYc) --- ![[CleanShot 2024-01-26 at 16.39.42.png]]![[CleanShot 2024-01-26 at 16.40.26.png]]![[CleanShot 2024-01-26 at 16.40.38.png]]![[CleanShot 2024-01-26 at 16.42.51.png]]![[CleanShot 2024-01-26 at 16.44.28.png]]![[CleanShot 2024-01-26 at 16.45.51.png]] [AI Observability At Meta Scale | Riham Selim, Valentin Andrei, Hao Wang and Lei Tian - YouTube](https://www.youtube.com/watch?v=9_iLFbNWoE8) --- - [Dynolog: Open source system observability](https://developers.facebook.com/blog/post/2022/11/16/dynolog-open-source-system-observability/) - [PyTorch Profiler — PyTorch Tutorials 2.2.0+cu121 documentation](https://pytorch.org/tutorials/recipes/recipes/profiler_recipe.html) - [Overview — NVIDIA DCGM Documentation latest documentation](https://docs.nvidia.com/datacenter/dcgm/latest/user-guide/index.html#) - [Reverse debugging at scale - Engineering at Meta](https://engineering.fb.com/2021/04/27/developer-tools/reverse-debugging/) - [Performance Debugging of Production PyTorch Models at Meta | PyTorch](https://pytorch.org/blog/performance-debugging-of-production-pytorch-models-at-meta/) - [Fix Performance Bottlenecks with Intel® VTune™ Profiler](https://www.intel.com/content/www/us/en/developer/tools/oneapi/vtune-profiler.html#gs.g1nfh4) - [Nsight Compute | NVIDIA Developer | NVIDIA Developer](https://developer.nvidia.com/nsight-compute) - [facebookincubator/dynolog: Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the linux kernel, CPU, disks, Intel PT, GPUs etc. Dynolog also integrates with pytorch and can trigger traces for distributed training applications.](https://github.com/facebookincubator/dynolog) - [pytorch/kineto: A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.](https://github.com/pytorch/kineto) - [Slurm Workload Manager - Documentation](https://slurm.schedmd.com/documentation.html) The last browser capture --- - [NVIDIA Visual Profiler | NVIDIA Developer](https://developer.nvidia.com/nvidia-visual-profiler) - [Performance Analysis Tools | NVIDIA Developer](https://developer.nvidia.com/performance-analysis-tools) - [1. Preparing An Application For Profiling — Profiler 12.3 documentation](https://docs.nvidia.com/cuda/profiler-users-guide/index.html) - [CUDA Profiling Tools Interface | NVIDIA Developer](https://developer.nvidia.com/cuda-profiling-tools-interface) - [Profiler](https://docs.nvidia.com/cuda/pdf/CUDA_Profiler_Users_Guide.pdf) - [Tag: Profiling | NVIDIA Technical Blog](https://developer.nvidia.com/blog/tag/profiling/) - [Kernel Profiling Guide :: Nsight Compute Documentation](https://docs.nvidia.com/nsight-compute/ProfilingGuide/index.html) - [CUDA Tools - Tools for Profiling and Debugging](https://events.prace-ri.eu/event/978/sessions/3044/attachments/1136/1863/profiling.pdf) - [Releases · JeremyMain/GPUProfiler](https://github.com/JeremyMain/GPUProfiler/releases) - [Profiling Deep Learning Applications with NVIDIA NSight - YouTube](https://www.youtube.com/watch?v=K27rLXkOiqo) - [Profiling GPU codes with Nsight - YouTube](https://www.youtube.com/watch?v=51K5EqGqzCM) - [Running CUDA Profilers on Linux: GPU Optimizations](https://codingbyexample.com/2020/09/25/cuda-profiling-linux/) - [GPU Profiler – NVIDIA Community Tool – Virtually Visual](https://virtuallyvisual.wordpress.com/2016/06/08/gpu-profiler-nvidia-community-tool-and-source-code/) - [GPU Profiling with BPF at Meta - Riham Selim - YouTube](https://www.youtube.com/watch?v=5xAghByteYc) - [eBPF: User-Defined Codes in Kernel - Guochao Xie](https://xieguochao.com/blog/programming/ebpf)