da0da3a4b4
* Rename calcXXX to calculateXXX * Add migraphx support * Add migraphx support * Add migraphx support * Add migraphx support * Add migraphx support * Add migraphx support * Use True for the flags * Add migraphx support * add face-swapper-weight * add face-swapper-weight to facefusion.ini * changes * change choice * Fix typing for xxxWeight * Feat/log inference session (#906) * Log inference session, Introduce time helper * Log inference session, Introduce time helper * Log inference session, Introduce time helper * Log inference session, Introduce time helper * Mark as NEXT * Follow industry standard x1, x2, y1 and y2 * Follow industry standard x1, x2, y1 and y2 * Follow industry standard in terms of naming (#908) * Follow industry standard in terms of naming * Improve xxx_embedding naming * Fix norm vs. norms * Reduce timeout to 5 * Sort out voice_extractor once again * changes * Introduce many to the occlusion mask (#910) * Introduce many to the occlusion mask * Then we use minimum * Add support for wmv * Run platform tests before has_execution_provider (#911) * Add support for wmv * Introduce benchmark mode (#912) * Honestly makes no difference to me * Honestly makes no difference to me * Fix wording * Bring back YuNet (#922) * Reintroduce YuNet without cv2 dependency * Fix variable naming * Avoid RGB to YUV colorshift using libx264rgb * Avoid RGB to YUV colorshift using libx264rgb * Make libx264 the default again * Make libx264 the default again * Fix types in ffmpeg builder * Fix quality stuff in ffmpeg builder * Fix quality stuff in ffmpeg builder * Add libx264rgb to test * Revamp Processors (#923) * Introduce new concept of pure target frames * Radical refactoring of process flow * Introduce new concept of pure target frames * Fix webcam * Minor improvements * Minor improvements * Use deque for video processing * Use deque for video processing * Extend the video manager * Polish deque * Polish deque * Deque is not even used * Improve speed with multiple futures * Fix temp frame mutation and * Fix RAM usage * Remove old types and manage method * Remove execution_queue_count * Use init_state for benchmarker to avoid issues * add voice extractor option * Change the order of voice extractor in code * Use official download urls * Use official download urls * add gui * fix preview * Add remote updates for voice extractor * fix crash on headless-run * update test_job_helper.py * Fix it for good * Remove pointless method * Fix types and unused imports * Revamp reference (#925) * Initial revamp of face references * Initial revamp of face references * Initial revamp of face references * Terminate find_similar_faces * Improve find mutant faces * Improve find mutant faces * Move sort where it belongs * Forward reference vision frame * Forward reference vision frame also in preview * Fix reference selection * Use static video frame * Fix CI * Remove reference type from frame processors * Improve some naming * Fix types and unused imports * Fix find mutant faces * Fix find mutant faces * Fix imports * Correct naming * Correct naming * simplify pad * Improve webcam performance on highres * Camera manager (#932) * Introduce webcam manager * Fix order * Rename to camera manager, improve video manager * Fix CI * Remove optional * Fix naming in webcam options * Avoid using temp faces (#933) * output video scale * Fix imports * output image scale * upscale fix (not limiter) * add unit test scale_resolution & remove unused methods * fix and add test * fix * change pack_resolution * fix tests * Simplify output scale testing * Fix benchmark UI * Fix benchmark UI * Update dependencies * Introduce REAL multi gpu support using multi dimensional inference pool (#935) * Introduce REAL multi gpu support using multi dimensional inference pool * Remove the MULTI:GPU flag * Restore "processing stop" * Restore "processing stop" * Remove old templates * Go fill in with caching * add expression restorer areas * re-arrange * rename method * Fix stop for extract frames and merge video * Replace arcface_converter models with latest crossface models * Replace arcface_converter models with latest crossface models * Move module logs to debug mode * Refactor/streamer (#938) * Introduce webcam manager * Fix order * Rename to camera manager, improve video manager * Fix CI * Fix naming in webcam options * Move logic over to streamer * Fix streamer, improve webcam experience * Improve webcam experience * Revert method * Revert method * Improve webcam again * Use release on capture instead * Only forward valid frames * Fix resolution logging * Add AVIF support * Add AVIF support * Limit avif to unix systems * Drop avif * Drop avif * Drop avif * Default to Documents in the UI if output path is not set * Update wording.py (#939) "succeed" is grammatically incorrect in the given context. To succeed is the infinitive form of the verb. Correct would be either "succeeded" or alternatively a form involving the noun "success". * Fix more grammar issue * Fix more grammar issue * Sort out caching * Move webcam choices back to UI * Move preview options to own file (#940) * Fix Migraphx execution provider * Fix benchmark * Reuse blend frame method * Fix CI * Fix CI * Fix CI * Hotfix missing check in face debugger, Enable logger for preview * Fix reference selection (#942) * Fix reference selection * Fix reference selection * Fix reference selection * Fix reference selection * Side by side preview (#941) * Initial side by side preview * More work on preview, remove UI only stuff from vision.py * Improve more * Use fit frame * Add different fit methods for vision * Improve preview part2 * Improve preview part3 * Improve preview part4 * Remove none as choice * Remove useless methods * Fix CI * Fix naming * use 1024 as preview resolution default * Fix fit_cover_frame * Uniform fit_xxx_frame methods * Add back disabled logger * Use ui choices alias * Extract select face logic from processors (#943) * Extract select face logic from processors to use it for face by face in preview * Fix order * Remove old code * Merge methods * Refactor face debugger (#944) * Refactor huge method of face debugger * Remove text metrics from face debugger * Remove useless copy of temp frame * Resort methods * Fix spacing * Remove old method * Fix hard exit to work without signals * Prevent upscaling for face-by-face * Switch to version * Improve exiting --------- Co-authored-by: harisreedhar <h4harisreedhar.s.s@gmail.com> Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com> Co-authored-by: Rafael Tappe Maestro <rafael@tappemaestro.com>
190 lines
8.2 KiB
Python
190 lines
8.2 KiB
Python
import os
|
|
import subprocess
|
|
import tempfile
|
|
|
|
import pytest
|
|
|
|
import facefusion.ffmpeg
|
|
from facefusion import process_manager, state_manager
|
|
from facefusion.download import conditional_download
|
|
from facefusion.ffmpeg import concat_video, extract_frames, merge_video, read_audio_buffer, replace_audio, restore_audio
|
|
from facefusion.filesystem import copy_file
|
|
from facefusion.temp_helper import clear_temp_directory, create_temp_directory, get_temp_file_path, resolve_temp_frame_paths
|
|
from facefusion.types import EncoderSet
|
|
from .helper import get_test_example_file, get_test_examples_directory, get_test_output_file, prepare_test_output_directory
|
|
|
|
|
|
@pytest.fixture(scope = 'module', autouse = True)
|
|
def before_all() -> None:
|
|
process_manager.start()
|
|
conditional_download(get_test_examples_directory(),
|
|
[
|
|
'https://github.com/facefusion/facefusion-assets/releases/download/examples-3.0.0/source.jpg',
|
|
'https://github.com/facefusion/facefusion-assets/releases/download/examples-3.0.0/source.mp3',
|
|
'https://github.com/facefusion/facefusion-assets/releases/download/examples-3.0.0/target-240p.mp4'
|
|
])
|
|
subprocess.run([ 'ffmpeg', '-i', get_test_example_file('source.mp3'), get_test_example_file('source.wav') ])
|
|
subprocess.run([ 'ffmpeg', '-i', get_test_example_file('target-240p.mp4'), '-vf', 'fps=25', get_test_example_file('target-240p-25fps.mp4') ])
|
|
subprocess.run([ 'ffmpeg', '-i', get_test_example_file('target-240p.mp4'), '-vf', 'fps=30', get_test_example_file('target-240p-30fps.mp4') ])
|
|
subprocess.run([ 'ffmpeg', '-i', get_test_example_file('target-240p.mp4'), '-vf', 'fps=60', get_test_example_file('target-240p-60fps.mp4') ])
|
|
|
|
for output_video_format in [ 'avi', 'm4v', 'mkv', 'mov', 'mp4', 'webm', 'wmv' ]:
|
|
subprocess.run([ 'ffmpeg', '-i', get_test_example_file('source.mp3'), '-i', get_test_example_file('target-240p.mp4'), '-ar', '16000', get_test_example_file('target-240p-16khz.' + output_video_format) ])
|
|
|
|
subprocess.run([ 'ffmpeg', '-i', get_test_example_file('source.mp3'), '-i', get_test_example_file('target-240p.mp4'), '-ar', '48000', get_test_example_file('target-240p-48khz.mp4') ])
|
|
state_manager.init_item('temp_path', tempfile.gettempdir())
|
|
state_manager.init_item('temp_frame_format', 'png')
|
|
state_manager.init_item('output_audio_encoder', 'aac')
|
|
state_manager.init_item('output_audio_quality', 100)
|
|
state_manager.init_item('output_audio_volume', 100)
|
|
state_manager.init_item('output_video_encoder', 'libx264')
|
|
state_manager.init_item('output_video_quality', 100)
|
|
state_manager.init_item('output_video_preset', 'ultrafast')
|
|
|
|
|
|
@pytest.fixture(scope = 'function', autouse = True)
|
|
def before_each() -> None:
|
|
prepare_test_output_directory()
|
|
|
|
|
|
def get_available_encoder_set() -> EncoderSet:
|
|
if os.getenv('CI'):
|
|
return\
|
|
{
|
|
'audio': [ 'aac' ],
|
|
'video': [ 'libx264' ]
|
|
}
|
|
return facefusion.ffmpeg.get_available_encoder_set()
|
|
|
|
|
|
def test_get_available_encoder_set() -> None:
|
|
available_encoder_set = get_available_encoder_set()
|
|
|
|
assert 'aac' in available_encoder_set.get('audio')
|
|
assert 'libx264' in available_encoder_set.get('video')
|
|
|
|
|
|
def test_extract_frames() -> None:
|
|
test_set =\
|
|
[
|
|
(get_test_example_file('target-240p-25fps.mp4'), 0, 270, 324),
|
|
(get_test_example_file('target-240p-25fps.mp4'), 224, 270, 55),
|
|
(get_test_example_file('target-240p-25fps.mp4'), 124, 224, 120),
|
|
(get_test_example_file('target-240p-25fps.mp4'), 0, 100, 120),
|
|
(get_test_example_file('target-240p-30fps.mp4'), 0, 324, 324),
|
|
(get_test_example_file('target-240p-30fps.mp4'), 224, 324, 100),
|
|
(get_test_example_file('target-240p-30fps.mp4'), 124, 224, 100),
|
|
(get_test_example_file('target-240p-30fps.mp4'), 0, 100, 100),
|
|
(get_test_example_file('target-240p-60fps.mp4'), 0, 648, 324),
|
|
(get_test_example_file('target-240p-60fps.mp4'), 224, 648, 212),
|
|
(get_test_example_file('target-240p-60fps.mp4'), 124, 224, 50),
|
|
(get_test_example_file('target-240p-60fps.mp4'), 0, 100, 50)
|
|
]
|
|
|
|
for target_path, trim_frame_start, trim_frame_end, frame_total in test_set:
|
|
create_temp_directory(target_path)
|
|
|
|
assert extract_frames(target_path, (452, 240), 30.0, trim_frame_start, trim_frame_end) is True
|
|
assert len(resolve_temp_frame_paths(target_path)) == frame_total
|
|
|
|
clear_temp_directory(target_path)
|
|
|
|
|
|
def test_merge_video() -> None:
|
|
target_paths =\
|
|
[
|
|
get_test_example_file('target-240p-16khz.avi'),
|
|
get_test_example_file('target-240p-16khz.m4v'),
|
|
get_test_example_file('target-240p-16khz.mkv'),
|
|
get_test_example_file('target-240p-16khz.mp4'),
|
|
get_test_example_file('target-240p-16khz.mov'),
|
|
get_test_example_file('target-240p-16khz.webm'),
|
|
get_test_example_file('target-240p-16khz.wmv')
|
|
]
|
|
output_video_encoders = get_available_encoder_set().get('video')
|
|
|
|
for target_path in target_paths:
|
|
for output_video_encoder in output_video_encoders:
|
|
state_manager.init_item('output_video_encoder', output_video_encoder)
|
|
create_temp_directory(target_path)
|
|
extract_frames(target_path, (452, 240), 25.0, 0, 1)
|
|
|
|
assert merge_video(target_path, 25.0, (452, 240), 25.0, 0, 1) is True
|
|
|
|
clear_temp_directory(target_path)
|
|
|
|
state_manager.init_item('output_video_encoder', 'libx264')
|
|
|
|
|
|
def test_concat_video() -> None:
|
|
output_path = get_test_output_file('test-concat-video.mp4')
|
|
temp_output_paths =\
|
|
[
|
|
get_test_example_file('target-240p-16khz.mp4'),
|
|
get_test_example_file('target-240p-16khz.mp4')
|
|
]
|
|
|
|
assert concat_video(output_path, temp_output_paths) is True
|
|
|
|
|
|
def test_read_audio_buffer() -> None:
|
|
assert isinstance(read_audio_buffer(get_test_example_file('source.mp3'), 1, 16, 1), bytes)
|
|
assert isinstance(read_audio_buffer(get_test_example_file('source.wav'), 1, 16, 1), bytes)
|
|
assert read_audio_buffer(get_test_example_file('invalid.mp3'), 1, 16, 1) is None
|
|
|
|
|
|
def test_restore_audio() -> None:
|
|
test_set =\
|
|
[
|
|
(get_test_example_file('target-240p-16khz.avi'), get_test_output_file('target-240p-16khz.avi')),
|
|
(get_test_example_file('target-240p-16khz.m4v'), get_test_output_file('target-240p-16khz.m4v')),
|
|
(get_test_example_file('target-240p-16khz.mkv'), get_test_output_file('target-240p-16khz.mkv')),
|
|
(get_test_example_file('target-240p-16khz.mov'), get_test_output_file('target-240p-16khz.mov')),
|
|
(get_test_example_file('target-240p-16khz.mp4'), get_test_output_file('target-240p-16khz.mp4')),
|
|
(get_test_example_file('target-240p-48khz.mp4'), get_test_output_file('target-240p-48khz.mp4')),
|
|
(get_test_example_file('target-240p-16khz.webm'), get_test_output_file('target-240p-16khz.webm')),
|
|
(get_test_example_file('target-240p-16khz.wmv'), get_test_output_file('target-240p-16khz.wmv'))
|
|
]
|
|
output_audio_encoders = get_available_encoder_set().get('audio')
|
|
|
|
for target_path, output_path in test_set:
|
|
create_temp_directory(target_path)
|
|
|
|
for output_audio_encoder in output_audio_encoders:
|
|
state_manager.init_item('output_audio_encoder', output_audio_encoder)
|
|
copy_file(target_path, get_temp_file_path(target_path))
|
|
|
|
assert restore_audio(target_path, output_path, 0, 270) is True
|
|
|
|
clear_temp_directory(target_path)
|
|
|
|
state_manager.init_item('output_audio_encoder', 'aac')
|
|
|
|
|
|
def test_replace_audio() -> None:
|
|
test_set =\
|
|
[
|
|
(get_test_example_file('target-240p-16khz.avi'), get_test_output_file('target-240p-16khz.avi')),
|
|
(get_test_example_file('target-240p-16khz.m4v'), get_test_output_file('target-240p-16khz.m4v')),
|
|
(get_test_example_file('target-240p-16khz.mkv'), get_test_output_file('target-240p-16khz.mkv')),
|
|
(get_test_example_file('target-240p-16khz.mov'), get_test_output_file('target-240p-16khz.mov')),
|
|
(get_test_example_file('target-240p-16khz.mp4'), get_test_output_file('target-240p-16khz.mp4')),
|
|
(get_test_example_file('target-240p-48khz.mp4'), get_test_output_file('target-240p-48khz.mp4')),
|
|
(get_test_example_file('target-240p-16khz.webm'), get_test_output_file('target-240p-16khz.webm'))
|
|
]
|
|
output_audio_encoders = get_available_encoder_set().get('audio')
|
|
|
|
for target_path, output_path in test_set:
|
|
create_temp_directory(target_path)
|
|
|
|
for output_audio_encoder in output_audio_encoders:
|
|
state_manager.init_item('output_audio_encoder', output_audio_encoder)
|
|
copy_file(target_path, get_temp_file_path(target_path))
|
|
|
|
assert replace_audio(target_path, get_test_example_file('source.mp3'), output_path) is True
|
|
assert replace_audio(target_path, get_test_example_file('source.wav'), output_path) is True
|
|
|
|
clear_temp_directory(target_path)
|
|
|
|
state_manager.init_item('output_audio_encoder', 'aac')
|