* Add real_hatgan_x4 model
* Mark it as NEXT
* Force download to be executed and exit
* Fix frame per second interpolation
* 5 to 68 landmark (#456)
* changes
* changes
* Adjust model url
* Cleanup 5 to 68 landmark convertion
* Move everything to face analyser
* Introduce matrix only face helper
* Revert facefusion.ini
* Adjust limit due false positive analysis
* changes (#457)
* Use pixel format yuv422p to merge video
* Fix some code
* Minor cleanup
* Add gpen_bfr_1024 and gpen_bfr_2048
* Revert it back to yuv420p due compatibility issues
* Add debug back to ffmpeg
* Add debug back to ffmpeg
* Migrate to conda (#461)
* Migrate from venv to conda
* Migrate from venv to conda
* Message when conda is not activated
* Use release for every slider (#463)
* Use release event handler for every slider
* Move more sliders to release handler
* Move more sliders to release handler
* Add get_ui_components() to simplify code
* Revert some changes on frame slider
* Add the first iteration of a frame colorizer
* Support for the DDColor model
* Improve model file handling
* Improve model file handling part2
* Remove deoldify
* Remove deoldify
* Voice separator (#468)
* changes
* changes
* changes
* changes
* changes
* changes
* Rename audio extractor to voice extractor
* Cosmetic changes
* Cosmetic changes
* Fix fps lowering and boosting
* Fix fps lowering and boosting
* Fix fps lowering and boosting
* Some refactoring for audio.py and some astype() here and there (#470)
* Some refactoring for audio.py and some astype() here and there
* Fix lint
* Spacing
* Add mp3 to benchmark suite for lip syncer testing
* Improve naming
* Adjust chunk size
* Use higher quality
* Revert "Use higher quality"
This reverts commit d32f28757251ecc0f48214073adf54f3631b1289.
* Improve naming in ffmpeg.py
* Simplify code
* Better fps calculation
* Fix naming here and there
* Add back real esrgan x2
* Remove trailing comma
* Update wording and README
* Use semaphore to prevent frame colorizer memory issues
* Revert "Remove deoldify"
This reverts commit bd8034cbc71fe701f78dddec3057dc98593b2162.
* Remove unused type from frame colorizer
* Adjust naming
* Add missing clear of model initializer
* Change nvenc preset mappping to support old FFMPEG 4
* Update onnxruntime to 1.17.1
* Fix lint
* Prepare 2.5.0
* Fix Gradio overrides
* Add Deoldify Artistic back
* Feat/audio refactoring (#476)
* Improve audio naming and variables
* Improve audio naming and variables
* Refactor voice extractor like crazy
* Refactor voice extractor like crazy
* Remove spaces
* Update the usage
---------
Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
* Rename landmark 5 variables
* Mark as NEXT
* Render tabs for multiple ui layout usage
* Allow many face detectors at once, Add face detector tweaks
* Remove face detector tweaks for now (kinda placebo)
* Fix lint issues
* Allow rendering the landmark-5 and landmark-5/68 via debugger
* Fix naming
* Convert face landmark based on confidence score
* Convert face landmark based on confidence score
* Add scrfd face detector model (#397)
* Add scrfd face detector model
* Switch to scrfd_2.5g.onnx model
* Just some renaming
* Downgrade OpenCV, Add SYSTEM_VERSION_COMPAT=0 for MacOS
* Improve naming
* prepare detect frame outside of semaphore
* Feat/process manager (#399)
* Minor naming
* Introduce process manager to start and stop
* Introduce process manager to start and stop
* Introduce process manager to start and stop
* Introduce process manager to start and stop
* Introduce process manager to start and stop
* Remove useless test for now
* Avoid useless variables
* Show stop once is_processing is True
* Allow to stop ffmpeg processing too
* Implement output image resolution (#403)
* Implement output image resolution
* Reorder code
* Simplify output logic and therefore fix bug
* Frame-enhancer-onnx (#404)
* changes
* changes
* changes
* changes
* add models
* update workflow
* Some cleanup
* Some cleanup
* Feat/frame enhancer polishing (#410)
* Some cleanup
* Polish the frame enhancer
* Frame Enhancer: Add more models, optimize processing
* Minor changes
* Improve readability of create_tile_frames and merge_tile_frames
* We don't have enough models yet
* Feat/face landmarker score (#413)
* Introduce face landmarker score
* Fix testing
* Fix testing
* Use release for score related sliders
* Reduce face landmark fallbacks
* Scores and landmarks in Face dict, Change color-theme in face debugger
* Scores and landmarks in Face dict, Change color-theme in face debugger
* Fix some naming
* Add 8K support (for whatever reasons)
* Fix testing
* Using get() for face.landmarks
* Introduce statistics
* More statistics
* Limit the histogram equalization
* Enable queue() for default layout
* Improve copy_image()
* Fix error when switching detector model
* Always set UI values with globals if possible
* Use different logic for output image and output video resolutions
* Enforce re-download if file size is off
* Remove unused method
* Remove unused method
* Remove unused warning filter
* Improved output path normalization (#419)
* Handle some exceptions
* Handle some exceptions
* Cleanup
* Prevent countless thread locks
* Listen to user feedback
* Fix webp edge case
* Feat/cuda device detection (#424)
* Introduce cuda device detection
* Introduce cuda device detection
* it's gtx
* Move logic to run_nvidia_smi()
* Finalize execution device naming
* Finalize execution device naming
* Merge execution_helper.py to execution.py
* Undo lowercase of values
* Undo lowercase of values
* Finalize naming
* Add missing entry to ini
* fix lip_syncer preview (#426)
* fix lip_syncer preview
* change
* Refresh preview on trim changes
* Cleanup frame enhancers and remove useless scale in merge_video() (#428)
* Keep lips over the whole video once lip syncer is enabled (#430)
* Keep lips over the whole video once lip syncer is enabled
* changes
* changes
* Fix spacing
* Use empty audio frame on silence
* Use empty audio frame on silence
* Fix ConfigParser encoding (#431)
facefusion.ini is UTF8 encoded but config.py doesn't specify encoding which results in corrupted entries when non english characters are used.
Affected entries:
source_paths
target_path
output_path
* Adjust spacing
* Improve the GTX 16 series detection
* Use general exception to catch ParseError
* Use general exception to catch ParseError
* Host frame enhancer models4
* Use latest onnxruntime
* Minor changes in benchmark UI
* Different approach to cancel ffmpeg process
* Add support for amd amf encoders (#433)
* Add amd_amf encoders
* remove -rc cqp from amf encoder parameters
* Improve terminal output, move success messages to debug mode
* Improve terminal output, move success messages to debug mode
* Minor update
* Minor update
* onnxruntime 1.17.1 matches cuda 12.2
* Feat/improved scaling (#435)
* Prevent useless temp upscaling, Show resolution and fps in terminal output
* Remove temp frame quality
* Remove temp frame quality
* Tiny cleanup
* Default back to png for temp frames, Remove pix_fmt from frame extraction due mjpeg error
* Fix inswapper fallback by onnxruntime
* Fix inswapper fallback by major onnxruntime
* Fix inswapper fallback by major onnxruntime
* Add testing for vision restrict methods
* Fix left / right face mask regions, add left-ear and right-ear
* Flip right and left again
* Undo ears - does not work with box mask
* Prepare next release
* Fix spacing
* 100% quality when using jpg for temp frames
* Use span_kendata_x4 as default as of speed
* benchmark optimal tile and pad
* Undo commented out code
* Add real_esrgan_x4_fp16 model
* Be strict when using many face detectors
---------
Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
Co-authored-by: aldemoth <159712934+aldemoth@users.noreply.github.com>
* Operating system specific installer options
* Update dependencies
* Sorting before NMS according to the standard
* Minor typing fix
* Change the wording
* Update preview.py (#222)
Added a release listener to the preview frame slider, this will update the frame preview with the latest frame
* Combine preview slider listener
* Remove change listener
* Introduce multi source (#223)
* Implement multi source
* Adjust face enhancer and face debugger to multi source
* Implement multi source to UI
* Implement multi source to UI part2
* Implement multi source to UI part3
* Implement multi source to UI part4
* Some cleanup
* Add face occluder (#225) (#226)
* Add face occluder (#225)
* add face-occluder (commandline only)
* review 1
* Update face_masker.py
* Update face_masker.py
* Add gui & fix typing
* Minor naming cleanup
* Minor naming cleanup part2
---------
Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
* Update usage information
* Fix averaged normed_embedding
* Remove blur from face occluder, enable accelerators
* Switch to RANSAC with 100 threshold
* Update face_enhancer.py (#229)
* Update face_debugger.py (#230)
* Split utilities (#232)
* Split utilities
* Split utilities part2
* Split utilities part3
* Split utilities part4
* Some cleanup
* Implement log level support (#233)
* Implement log level support
* Fix testing
* Implement debug logger
* Implement debug logger
* Fix alignment offset (#235)
* Update face_helper.py
* fix 2
* Enforce virtual environment via installer
* Enforce virtual environment via installer
* Enforce virtual environment via installer
* Enforce virtual environment via installer
* Feat/multi process reference faces (#239)
* Multi processing aware reference faces
* First clean up and joining of files
* Finalize the face store
* Reduce similar face detection to one set, use __name__ for scopes in logger
* Rename to face_occluder
* Introduce ModelSet type
* Improve webcam error handling
* Prevent null pointer on is_image() and is_video()
* Prevent null pointer on is_image() and is_video()
* Fix find similar faces
* Fix find similar faces
* Fix process_images for face enhancer
* Bunch of minor improvements
* onnxruntime for ROCM under linux
* Improve mask related naming
* Fix falsy import
* Fix typo
* Feat/face parser refactoring (#247)
* Face parser update (#244)
* face-parser
* Update face_masker.py
* update debugger
* Update globals.py
* Update face_masker.py
* Refactor code to split occlusion from region
* fix (#246)
* fix
* fix debugger resolution
* flip input to horizontal
* Clean up UI
* Reduce the regions to inside face only
* Reduce the regions to inside face only
---------
Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
* Fix enhancer, remove useless dest in add_argument()
* Prevent unselect of the face_mask_regions via UI
* Prepare next release
* Shorten arguments that have choices and nargs
* Add missing clear to face debugger
---------
Co-authored-by: Mathias <github@feroc.de>
Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
* Improve typing for our callbacks
* Return 0 for get_download_size
* Introduce ONNX powered face enhancer
* Introduce ONNX powered face enhancer
* Introduce ONNX powered face enhancer
* Remove tile processing from frame enhancer
* Fix video compress translation for libvpx-vp9
* Allow zero values for video compression
* Develop (#134)
* Introduce model options to the frame processors
* Finish UI to select frame processors models
* Simplify frame processors options
* Fix lint in CI
* Rename all kind of settings to options
* Add blend to enhancers
* Simplify webcam mode naming
* Bypass SSL issues under Windows
* Fix blend of frame enhancer
* Massive CLI refactoring, Register and apply ARGS via the frame processors
* Refine UI theme and introduce donate button
* Update dependencies and fix cpu only torch
* Update dependencies and fix cpu only torch
* Fix theme, Fix frame_processors in headless mode
* Remove useless astype
* Disable CoreML for the ONNX face enhancer
* Disable CoreML for the ONNX face enhancer
* Predict webcam too
* Improve resize of preview
* Change output quality defaults, Move options to the right
* Support for codeformer model
* Update the typo
* Add GPEN and GFPGAN 1.2
* Extract blend_frame methods
* Extend the installer
* Revert broken Gradio
* Rework on ui components
* Move output path selector to the output options
* Remove tons of pointless component updates
* Reset more base theme styling
* Use latest Gradio
* Fix the sliders
* More styles
* Update torch to 2.1.0
* Add RealESRNet_x4plus
* Fix that button
* Use latest onnxruntime-silicon
* Looks stable to me
* Lowercase model keys, Update preview and readme