Commit Graph

56 Commits

Author SHA1 Message Date
Henry Ruhs
f3be23d19b Patch (#947)
* Fix preview when using frame enhancer

* Fix version conflict numpy vs. cv2

* Use latest numpy

* Introduce scale_face() to match size of temp frames and target frames

* Remove hardcoded backend for camera under Windows

* Up and downgrade some dependencies

* Up and downgrade some dependencies

* Up and downgrade some dependencies
2025-09-11 16:58:39 +02:00
Henry Ruhs
da0da3a4b4 Next (#945)
* Rename calcXXX to calculateXXX

* Add migraphx support

* Add migraphx support

* Add migraphx support

* Add migraphx support

* Add migraphx support

* Add migraphx support

* Use True for the flags

* Add migraphx support

* add face-swapper-weight

* add face-swapper-weight to facefusion.ini

* changes

* change choice

* Fix typing for xxxWeight

* Feat/log inference session (#906)

* Log inference session, Introduce time helper

* Log inference session, Introduce time helper

* Log inference session, Introduce time helper

* Log inference session, Introduce time helper

* Mark as NEXT

* Follow industry standard x1, x2, y1 and y2

* Follow industry standard x1, x2, y1 and y2

* Follow industry standard in terms of naming (#908)

* Follow industry standard in terms of naming

* Improve xxx_embedding naming

* Fix norm vs. norms

* Reduce timeout to 5

* Sort out voice_extractor once again

* changes

* Introduce many to the occlusion mask (#910)

* Introduce many to the occlusion mask

* Then we use minimum

* Add support for wmv

* Run platform tests before has_execution_provider (#911)

* Add support for wmv

* Introduce benchmark mode (#912)

* Honestly makes no difference to me

* Honestly makes no difference to me

* Fix wording

* Bring back YuNet (#922)

* Reintroduce YuNet without cv2 dependency

* Fix variable naming

* Avoid RGB to YUV colorshift using libx264rgb

* Avoid RGB to YUV colorshift using libx264rgb

* Make libx264 the default again

* Make libx264 the default again

* Fix types in ffmpeg builder

* Fix quality stuff in ffmpeg builder

* Fix quality stuff in ffmpeg builder

* Add libx264rgb to test

* Revamp Processors (#923)

* Introduce new concept of pure target frames

* Radical refactoring of process flow

* Introduce new concept of pure target frames

* Fix webcam

* Minor improvements

* Minor improvements

* Use deque for video processing

* Use deque for video processing

* Extend the video manager

* Polish deque

* Polish deque

* Deque is not even used

* Improve speed with multiple futures

* Fix temp frame mutation and

* Fix RAM usage

* Remove old types and manage method

* Remove execution_queue_count

* Use init_state for benchmarker to avoid issues

* add voice extractor option

* Change the order of voice extractor in code

* Use official download urls

* Use official download urls

* add gui

* fix preview

* Add remote updates for voice extractor

* fix crash on headless-run

* update test_job_helper.py

* Fix it for good

* Remove pointless method

* Fix types and unused imports

* Revamp reference (#925)

* Initial revamp of face references

* Initial revamp of face references

* Initial revamp of face references

* Terminate find_similar_faces

* Improve find mutant faces

* Improve find mutant faces

* Move sort where it belongs

* Forward reference vision frame

* Forward reference vision frame also in preview

* Fix reference selection

* Use static video frame

* Fix CI

* Remove reference type from frame processors

* Improve some naming

* Fix types and unused imports

* Fix find mutant faces

* Fix find mutant faces

* Fix imports

* Correct naming

* Correct naming

* simplify pad

* Improve webcam performance on highres

* Camera manager (#932)

* Introduce webcam manager

* Fix order

* Rename to camera manager, improve video manager

* Fix CI

* Remove optional

* Fix naming in webcam options

* Avoid using temp faces (#933)

* output video scale

* Fix imports

* output image scale

* upscale fix (not limiter)

* add unit test scale_resolution & remove unused methods

* fix and add test

* fix

* change pack_resolution

* fix tests

* Simplify output scale testing

* Fix benchmark UI

* Fix benchmark UI

* Update dependencies

* Introduce REAL multi gpu support using multi dimensional inference pool (#935)

* Introduce REAL multi gpu support using multi dimensional inference pool

* Remove the MULTI:GPU flag

* Restore "processing stop"

* Restore "processing stop"

* Remove old templates

* Go fill in with caching

* add expression restorer areas

* re-arrange

* rename method

* Fix stop for extract frames and merge video

* Replace arcface_converter models with latest crossface models

* Replace arcface_converter models with latest crossface models

* Move module logs to debug mode

* Refactor/streamer (#938)

* Introduce webcam manager

* Fix order

* Rename to camera manager, improve video manager

* Fix CI

* Fix naming in webcam options

* Move logic over to streamer

* Fix streamer, improve webcam experience

* Improve webcam experience

* Revert method

* Revert method

* Improve webcam again

* Use release on capture instead

* Only forward valid frames

* Fix resolution logging

* Add AVIF support

* Add AVIF support

* Limit avif to unix systems

* Drop avif

* Drop avif

* Drop avif

* Default to Documents in the UI if output path is not set

* Update wording.py (#939)

"succeed" is grammatically incorrect in the given context. To succeed is the infinitive form of the verb. Correct would be either "succeeded" or alternatively a form involving the noun "success".

* Fix more grammar issue

* Fix more grammar issue

* Sort out caching

* Move webcam choices back to UI

* Move preview options to own file (#940)

* Fix Migraphx execution provider

* Fix benchmark

* Reuse blend frame method

* Fix CI

* Fix CI

* Fix CI

* Hotfix missing check in face debugger, Enable logger for preview

* Fix reference selection (#942)

* Fix reference selection

* Fix reference selection

* Fix reference selection

* Fix reference selection

* Side by side preview (#941)

* Initial side by side preview

* More work on preview, remove UI only stuff from vision.py

* Improve more

* Use fit frame

* Add different fit methods for vision

* Improve preview part2

* Improve preview part3

* Improve preview part4

* Remove none as choice

* Remove useless methods

* Fix CI

* Fix naming

* use 1024 as preview resolution default

* Fix fit_cover_frame

* Uniform fit_xxx_frame methods

* Add back disabled logger

* Use ui choices alias

* Extract select face logic from processors (#943)

* Extract select face logic from processors to use it for face by face in preview

* Fix order

* Remove old code

* Merge methods

* Refactor face debugger (#944)

* Refactor huge method of face debugger

* Remove text metrics from face debugger

* Remove useless copy of temp frame

* Resort methods

* Fix spacing

* Remove old method

* Fix hard exit to work without signals

* Prevent upscaling for face-by-face

* Switch to version

* Improve exiting

---------

Co-authored-by: harisreedhar <h4harisreedhar.s.s@gmail.com>
Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
Co-authored-by: Rafael Tappe Maestro <rafael@tappemaestro.com>
2025-09-08 10:43:58 +02:00
henryruhs
7b8bea4e0a Make HyperSwap the default 2025-07-10 15:22:41 +02:00
henryruhs
5c1b6ad5ad Remove weight multiplier from edtalk 2025-06-22 14:38:56 +02:00
henryruhs
43e1e4bf44 Prepare HyperSwap models 2025-06-20 15:34:21 +02:00
henryruhs
6bc948b94f Cosmetic spaces 2025-06-19 08:54:30 +02:00
henryruhs
6f9997bd31 Fix lip syncer 2025-06-19 08:41:06 +02:00
henryruhs
c390c6d882 Add HyperSwap (no models yet) 2025-06-17 19:24:16 +02:00
henryruhs
b76ca08dea cosmetics changes on lip syncer 2025-06-17 19:18:46 +02:00
henryruhs
543013fcf3 Implement area mask, refactor box mask 2025-06-13 18:42:14 +02:00
henryruhs
4d34a92f6f Implement area mask, refactor box mask 2025-06-13 18:39:37 +02:00
harisreedhar
bdc186f67b lipsyncer: revert to old bbox setting 2025-06-13 12:29:50 +05:30
henryruhs
74a40cec2e Fix wav2lip 2025-06-12 18:13:19 +02:00
henryruhs
3df70b14ca Kill some elif 2025-06-12 17:54:30 +02:00
henryruhs
885a9b044f Kill some elif and else 2025-06-12 17:43:54 +02:00
henryruhs
4150cda64e Fix spacing 2025-06-12 17:36:48 +02:00
harisreedhar
7905cfe6a3 stage 1 OCD 2025-06-12 20:07:41 +05:30
harisreedhar
36cad4d1b7 add edtalk 2025-06-12 19:08:26 +05:30
harisreedhar
fb05361dc3 space 2025-06-12 17:18:37 +05:30
harisreedhar
8aec81d63b re-arrange to methods 2025-06-12 17:07:51 +05:30
henryruhs
ed67b83eb3 Fix wrong area 2025-06-12 11:14:53 +02:00
henryruhs
2cad038ca3 Add landmark powered face areas 2025-06-11 14:40:34 +02:00
henryruhs
9fc32f2d94 Introduce lip syncer weight 2025-06-09 16:32:40 +02:00
henryruhs
28081e32f1 Introduce lip syncer weight 2025-06-09 15:05:56 +02:00
henryruhs
f05f74f5a1 Introduce lip syncer weight 2025-06-09 15:02:28 +02:00
henryruhs
076c313842 Change of plans 2025-06-04 22:29:46 +02:00
henryruhs
e5046a444e Turns out ultra_sharp_2_x4 needs huge tiles 2025-05-27 13:02:59 +02:00
henryruhs
bbad9a4732 Add ultra_sharp_2_x4 to frame enhancers 2025-05-27 12:48:37 +02:00
henryruhs
62483fdfad Introduce video manager to handle broken videos 2025-05-22 09:26:36 +02:00
henryruhs
7c2308f19e Replace Patrick Stewart model 2025-05-16 15:42:44 +02:00
henryruhs
1687ed7b58 Add more DeepFaceLive models 2025-05-05 14:16:57 +02:00
henryruhs
5118c7229f Rename arcface_128_v2 to arcface_128 2025-04-28 10:03:29 +02:00
henryruhs
72a0edb6ba Use module_name everywhere 2025-04-28 10:03:29 +02:00
henryruhs
b480c76e35 Follow the config parser way part3 2025-04-28 10:03:29 +02:00
henryruhs
3250f39708 Follow the config parser way part2 2025-04-28 10:03:29 +02:00
henryruhs
671acae887 Follow the config parser way 2025-04-28 10:03:29 +02:00
henryruhs
41514c2d67 Fix model size detection 2025-04-28 10:03:25 +02:00
Henry Ruhs
f3bbd3e16f Qa/follow set naming (#867)
* Follow set naming

* Follow set naming

* Disable type hints

* Uniform order
2025-04-28 10:03:25 +02:00
henryruhs
1bdc02014c Fix broken inference pools part2 2025-04-28 10:03:25 +02:00
Henry Ruhs
5e3ab88f63 Fix broken inference pools (#866)
* Fix broken inference pools

* Fix broken inference pools
2025-04-28 10:03:25 +02:00
henryruhs
44165eb0b7 Rename typing to types 2025-04-28 10:03:25 +02:00
henryruhs
efc9652df4 Extend flake8 rules 2025-04-28 10:03:25 +02:00
henryruhs
4f32ed7868 Rename to read_video_frame 2025-04-28 10:03:25 +02:00
henryruhs
f4255e66fa Add new model by Druuzil 2025-04-28 10:03:25 +02:00
Henry Ruhs
3b80d66bf4 Feat/better resolve execution (#856)
* A better way to resolve execution providers

* Fix issues

* Fix issues
2025-04-28 10:03:25 +02:00
henryruhs
330f86a4e4 Use 255.0 everywhere 2025-04-28 10:03:25 +02:00
henryruhs
ed8e25dbb2 Drop has_inference_model and solve issue on Gradio side 2025-04-28 10:03:25 +02:00
Henry Ruhs
8a9e08f3a2 Feat/commands builder (#852)
* Protype for ffmpeg builder

* Protype for ffmpeg builder

* Add curl builder

* Fix typing import

* Adjust commands indent

* Protype for ffmpeg builder part2

* Protype for ffmpeg builder part3

* Protype for ffmpeg builder part3

* Add chain() helper to the builders

* Protype for ffmpeg builder part4

* Protype for ffmpeg builder part5

* Protoype for ffmpeg builder part5

* Protoype for ffmpeg builder part6

* Allow dynamic audio size

* Fix testing

* Protoype for ffmpeg builder part7

* Fix and polish ffmpeg builder

* Hardcode the log level for ffmpeg

* More ffmpeg rework

* Prototype for ffmpeg builder part8

* Prototype for ffmpeg builder part9

* Fix CI

* Fix Styles

* Add lazy testing, User Agent for CURL

* More testing

* More testing
2025-04-28 10:03:24 +02:00
Henry Ruhs
c5bc7c50a5 Fix/remote inference pool lookups (#848)
* Fix edge case when offline and inference session has no model, Prevent inference session creation

* Fix edge case when offline and inference session has no model, Prevent inference session creation

* Fix edge case when offline and inference session has no model, Prevent inference session creation

* Fix edge case when offline and inference session has no model, Prevent inference session creation
2025-04-28 10:03:24 +02:00
Henry Ruhs
6f0675030e Feat/custom file format handling (#845)
* Purge filetype dependency, Rename file_extension to file_format, Introduce custom format detections

* Changed a lot

* Purge filetype dependency, Rename file_extension to file_format, Introduce custom format detections

* Fix stuff

* Fix stuff

* Simplify all the is_ and has_ methods

* Simplify all the is_ and has_ methods

* Use the new helper on more places

* Introduce are_ next to is_ and has_

* Get rid of the type-ignores

* Add more video types
2025-04-28 10:03:24 +02:00