* feat/yoloface (#334) * added yolov8 to face_detector (#323) * added yolov8 to face_detector * added yolov8 to face_detector * Initial cleanup and renaming * Update README * refactored detect_with_yoloface (#329) * refactored detect_with_yoloface * apply review * Change order again * Restore working code * modified code (#330) * refactored detect_with_yoloface * apply review * use temp_frame in detect_with_yoloface * reorder * modified * reorder models * Tiny cleanup --------- Co-authored-by: tamoharu <133945583+tamoharu@users.noreply.github.com> * include audio file functions (#336) * Add testing for audio handlers * Change order * Fix naming * Use correct typing in choices * Update help message for arguments, Notation based wording approach (#347) * Update help message for arguments, Notation based wording approach * Fix installer * Audio functions (#345) * Update ffmpeg.py * Create audio.py * Update ffmpeg.py * Update audio.py * Update audio.py * Update typing.py * Update ffmpeg.py * Update audio.py * Rename Frame to VisionFrame (#346) * Minor tidy up * Introduce audio testing * Add more todo for testing * Add more todo for testing * Fix indent * Enable venv on the fly * Enable venv on the fly * Revert venv on the fly * Revert venv on the fly * Force Gradio to shut up * Force Gradio to shut up * Clear temp before processing * Reduce terminal output * include audio file functions * Enforce output resolution on merge video * Minor cleanups * Add age and gender to face debugger items (#353) * Add age and gender to face debugger items * Rename like suggested in the code review * Fix the output framerate vs. time * Lip Sync (#356) * Cli implementation of wav2lip * - create get_first_item() - remove non gan wav2lip model - implement video memory strategy - implement get_reference_frame() - implement process_image() - rearrange crop_mask_list - implement test_cli * Simplify testing * Rename to lip syncer * Fix testing * Fix testing * Minor cleanup * Cuda 12 installer (#362) * Make cuda nightly (12) the default * Better keep legacy cuda just in case * Use CUDA and ROCM versions * Remove MacOS options from installer (CoreML include in default package) * Add lip-syncer support to source component * Add lip-syncer support to source component * Fix the check in the source component * Add target image check * Introduce more helpers to suite the lip-syncer needs * Downgrade onnxruntime as of buggy 1.17.0 release * Revert "Downgrade onnxruntime as of buggy 1.17.0 release" This reverts commit f4a7ae6824fed87f0be50906bbc7e2d61d00617b. * More testing and add todos * Fix the frame processor API to at least not throw errors * Introduce dict based frame processor inputs (#364) * Introduce dict based frame processor inputs * Forgot to adjust webcam * create path payloads (#365) * create index payload to paths for process_frames * rename to payload_paths * This code now is poetry * Fix the terminal output * Make lip-syncer work in the preview * Remove face debugger test for now * Reoder reference_faces, Fix testing * Use inswapper_128 on buggy onnxruntime 1.17.0 * Undo inswapper_128_fp16 duo broken onnxruntime 1.17.0 * Undo inswapper_128_fp16 duo broken onnxruntime 1.17.0 * Fix lip_syncer occluder & region mask issue * Fix preview once in case there was no output video fps * fix lip_syncer custom fps * remove unused import * Add 68 landmark functions (#367) * Add 68 landmark model * Add landmark to face object * Re-arrange and modify typing * Rename function * Rearrange * Rearrange * ignore type * ignore type * change type * ignore * name * Some cleanup * Some cleanup * Opps, I broke something * Feat/face analyser refactoring (#369) * Restructure face analyser and start TDD * YoloFace and Yunet testing are passing * Remove offset from yoloface detection * Cleanup code * Tiny fix * Fix get_many_faces() * Tiny fix (again) * Use 320x320 fallback for retinaface * Fix merging mashup * Upload wave2lip model * Upload 2dfan2 model and rename internal to face_predictor * Downgrade onnxruntime for most cases * Update for the face debugger to render landmark 68 * Try to make detect_face_landmark_68() and detect_gender_age() more uniform * Enable retinaface testing for 320x320 * Make detect_face_landmark_68() and detect_gender_age() as uniform as … (#370) * Make detect_face_landmark_68() and detect_gender_age() as uniform as possible * Revert landmark scale and translation * Make box-mask for lip-syncer adjustable * Add create_bbox_from_landmark() * Remove currently unused code * Feat/uniface (#375) * add uniface (#373) * Finalize UniFace implementation --------- Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com> * My approach how todo it * edit * edit * replace vertical blur with gaussian * remove region mask * Rebase against next and restore method * Minor improvements * Minor improvements * rename & add forehead padding * Adjust and host uniface model * Use 2dfan4 model * Rename to face landmarker * Feat/replace bbox with bounding box (#380) * Add landmark 68 to 5 convertion * Add landmark 68 to 5 convertion * Keep 5, 5/68 and 68 landmarks * Replace kps with landmark * Replace bbox with bounding box * Reshape face_landmark5_list different * Make yoloface the default * Move convert_face_landmark_68_to_5 to face_helper * Minor spacing issue * Dynamic detector sizes according to model (#382) * Dynamic detector sizes according to model * Dynamic detector sizes according to model * Undo false commited files * Add lib syncer model to the UI * fix halo (#383) * Bump to 2.3.0 * Update README and wording * Update README and wording * Fix spacing * Apply _vision suffix * Apply _vision suffix * Apply _vision suffix * Apply _vision suffix * Apply _vision suffix * Apply _vision suffix * Apply _vision suffix, Move mouth mask to face_masker.py * Apply _vision suffix * Apply _vision suffix * increase forehead padding --------- Co-authored-by: tamoharu <133945583+tamoharu@users.noreply.github.com> Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com>
110 lines
3.3 KiB
Python
110 lines
3.3 KiB
Python
from typing import List, Optional
|
|
import glob
|
|
import os
|
|
import shutil
|
|
import tempfile
|
|
import filetype
|
|
from pathlib import Path
|
|
|
|
import facefusion.globals
|
|
|
|
TEMP_DIRECTORY_PATH = os.path.join(tempfile.gettempdir(), 'facefusion')
|
|
TEMP_OUTPUT_VIDEO_NAME = 'temp.mp4'
|
|
|
|
|
|
def get_temp_frame_paths(target_path : str) -> List[str]:
|
|
temp_frames_pattern = get_temp_frames_pattern(target_path, '*')
|
|
return sorted(glob.glob(temp_frames_pattern))
|
|
|
|
|
|
def get_temp_frames_pattern(target_path : str, temp_frame_prefix : str) -> str:
|
|
temp_directory_path = get_temp_directory_path(target_path)
|
|
return os.path.join(temp_directory_path, temp_frame_prefix + '.' + facefusion.globals.temp_frame_format)
|
|
|
|
|
|
def get_temp_directory_path(target_path : str) -> str:
|
|
target_name, _ = os.path.splitext(os.path.basename(target_path))
|
|
return os.path.join(TEMP_DIRECTORY_PATH, target_name)
|
|
|
|
|
|
def get_temp_output_video_path(target_path : str) -> str:
|
|
temp_directory_path = get_temp_directory_path(target_path)
|
|
return os.path.join(temp_directory_path, TEMP_OUTPUT_VIDEO_NAME)
|
|
|
|
|
|
def create_temp(target_path : str) -> None:
|
|
temp_directory_path = get_temp_directory_path(target_path)
|
|
Path(temp_directory_path).mkdir(parents = True, exist_ok = True)
|
|
|
|
|
|
def move_temp(target_path : str, output_path : str) -> None:
|
|
temp_output_video_path = get_temp_output_video_path(target_path)
|
|
if is_file(temp_output_video_path):
|
|
if is_file(output_path):
|
|
os.remove(output_path)
|
|
shutil.move(temp_output_video_path, output_path)
|
|
|
|
|
|
def clear_temp(target_path : str) -> None:
|
|
temp_directory_path = get_temp_directory_path(target_path)
|
|
parent_directory_path = os.path.dirname(temp_directory_path)
|
|
if not facefusion.globals.keep_temp and is_directory(temp_directory_path):
|
|
shutil.rmtree(temp_directory_path)
|
|
if os.path.exists(parent_directory_path) and not os.listdir(parent_directory_path):
|
|
os.rmdir(parent_directory_path)
|
|
|
|
|
|
def is_file(file_path : str) -> bool:
|
|
return bool(file_path and os.path.isfile(file_path))
|
|
|
|
|
|
def is_directory(directory_path : str) -> bool:
|
|
return bool(directory_path and os.path.isdir(directory_path))
|
|
|
|
|
|
def is_audio(audio_path : str) -> bool:
|
|
return is_file(audio_path) and filetype.helpers.is_audio(audio_path)
|
|
|
|
|
|
def has_audio(audio_paths : List[str]) -> bool:
|
|
if audio_paths:
|
|
return any(is_audio(audio_path) for audio_path in audio_paths)
|
|
return False
|
|
|
|
|
|
def is_image(image_path : str) -> bool:
|
|
return is_file(image_path) and filetype.helpers.is_image(image_path)
|
|
|
|
|
|
def has_image(image_paths: List[str]) -> bool:
|
|
if image_paths:
|
|
return any(is_image(image_path) for image_path in image_paths)
|
|
return False
|
|
|
|
|
|
def is_video(video_path : str) -> bool:
|
|
return is_file(video_path) and filetype.helpers.is_video(video_path)
|
|
|
|
|
|
def filter_audio_paths(paths : List[str]) -> List[str]:
|
|
if paths:
|
|
return [ path for path in paths if is_audio(path) ]
|
|
return []
|
|
|
|
|
|
def filter_image_paths(paths : List[str]) -> List[str]:
|
|
if paths:
|
|
return [ path for path in paths if is_image(path) ]
|
|
return []
|
|
|
|
|
|
def resolve_relative_path(path : str) -> str:
|
|
return os.path.abspath(os.path.join(os.path.dirname(__file__), path))
|
|
|
|
|
|
def list_directory(directory_path : str) -> Optional[List[str]]:
|
|
if is_directory(directory_path):
|
|
files = os.listdir(directory_path)
|
|
return sorted([ Path(file).stem for file in files if not Path(file).stem.startswith(('.', '__')) ])
|
|
return None
|