OBS 源码解读——编码器

编码器

obs-encoder.h

主要包含
3个结构体定义:输入编码器数据;编码后数据;编码器定义
1个对外输出的注册编码器函数

输入编码器数据

/** Encoder input frame */
struct encoder_frame {/** Data for the frame/audio */uint8_t *data[MAX_AV_PLANES];/** size of each plane */uint32_t linesize[MAX_AV_PLANES];/** Number of frames (audio only) */uint32_t frames;/** Presentation timestamp */int64_t pts;
};

编码器输出数据

/** Encoder output packet */
struct encoder_packet {uint8_t *data; /**< Packet data */size_t size;   /**< Packet size */int64_t pts; /**< Presentation timestamp */int64_t dts; /**< Decode timestamp */int32_t timebase_num; /**< Timebase numerator */int32_t timebase_den; /**< Timebase denominator */enum obs_encoder_type type; /**< Encoder type */bool keyframe; /**< Is a keyframe *//* ---------------------------------------------------------------- *//* Internal video variables (will be parsed automatically) *//* DTS in microseconds */int64_t dts_usec;/* System DTS in microseconds */int64_t sys_dts_usec;/*** Packet priority** This is generally use by video encoders to specify the priority* of the packet.*/int priority;/*** Dropped packet priority** If this packet needs to be dropped, the next packet must be of this* priority or higher to continue transmission.*/int drop_priority;/** Audio track index (used with outputs) */size_t track_idx;/** Encoder from which the track originated from */obs_encoder_t *encoder;
};

编码器接口定义

/*** Encoder interface** Encoders have a limited usage with OBS.  You are not generally supposed to* implement every encoder out there.  Generally, these are limited or specific* encoders for h264/aac for streaming and recording.  It doesn't have to be* *just* h264 or aac of course, but generally those are the expected encoders.** That being said, other encoders will be kept in mind for future use.*/
struct obs_encoder_info {/* ----------------------------------------------------------------- *//* Required implementation*//** Specifies the named identifier of this encoder */const char *id;/** Specifies the encoder type (video or audio) */enum obs_encoder_type type;/** Specifies the codec */const char *codec;/*** Gets the full translated name of this encoder** @param  type_data  The type_data variable of this structure* @return            Translated name of the encoder*/const char *(*get_name)(void *type_data);/*** Creates the encoder with the specified settings** @param  settings  Settings for the encoder* @param  encoder   OBS encoder context* @return           Data associated with this encoder context, or*                   NULL if initialization failed.*/void *(*create)(obs_data_t *settings, obs_encoder_t *encoder);/*** Destroys the encoder data** @param  data  Data associated with this encoder context*/void (*destroy)(void *data);/*** Encodes frame(s), and outputs encoded packets as they become* available.** @param       data             Data associated with this encoder*                               context* @param[in]   frame            Raw audio/video data to encode* @param[out]  packet           Encoder packet output, if any* @param[out]  received_packet  Set to true if a packet was received,*                               false otherwise* @return                       true if successful, false otherwise.*/bool (*encode)(void *data, struct encoder_frame *frame,struct encoder_packet *packet, bool *received_packet);/** Audio encoder only:  Returns the frame size for this encoder */size_t (*get_frame_size)(void *data);/* ----------------------------------------------------------------- *//* Optional implementation *//*** Gets the default settings for this encoder** @param[out]  settings  Data to assign default settings to*/void (*get_defaults)(obs_data_t *settings);/*** Gets the property information of this encoder** @return         The properties data*/obs_properties_t *(*get_properties)(void *data);/*** Updates the settings for this encoder (usually used for things like* changing bitrate while active)** @param  data      Data associated with this encoder context* @param  settings  New settings for this encoder* @return           true if successful, false otherwise*/bool (*update)(void *data, obs_data_t *settings);/*** Returns extra data associated with this encoder (usually header)** @param  data             Data associated with this encoder context* @param[out]  extra_data  Pointer to receive the extra data* @param[out]  size        Pointer to receive the size of the extra*                          data* @return                  true if extra data available, false*                          otherwise*/bool (*get_extra_data)(void *data, uint8_t **extra_data, size_t *size);/*** Gets the SEI data, if any** @param       data      Data associated with this encoder context* @param[out]  sei_data  Pointer to receive the SEI data* @param[out]  size      Pointer to receive the SEI data size* @return                true if SEI data available, false otherwise*/bool (*get_sei_data)(void *data, uint8_t **sei_data, size_t *size);/*** Returns desired audio format and sample information** @param          data  Data associated with this encoder context* @param[in/out]  info  Audio format information*/void (*get_audio_info)(void *data, struct audio_convert_info *info);/*** Returns desired video format information** @param          data  Data associated with this encoder context* @param[in/out]  info  Video format information*/void (*get_video_info)(void *data, struct video_scale_info *info);void *type_data;void (*free_type_data)(void *type_data);uint32_t caps;/*** Gets the default settings for this encoder** If get_defaults is also defined both will be called, and the first* call will be to get_defaults, then to get_defaults2.** @param[out]  settings  Data to assign default settings to* @param[in]   typedata  Type Data*/void (*get_defaults2)(obs_data_t *settings, void *type_data);/*** Gets the property information of this encoder** @param[in]   data      Pointer from create (or null)* @param[in]   typedata  Type Data* @return                The properties data*/obs_properties_t *(*get_properties2)(void *data, void *type_data);bool (*encode_texture)(void *data, uint32_t handle, int64_t pts,uint64_t lock_key, uint64_t *next_key,struct encoder_packet *packet,bool *received_packet);
};

对外输出的注册编码器函数

EXPORT void obs_register_encoder_s(const struct obs_encoder_info *info,size_t size);/*** Register an encoder definition to the current obs context.  This should be* used in obs_module_load.** @param  info  Pointer to the source definition structure.*/
#define obs_register_encoder(info) \obs_register_encoder_s(info, sizeof(struct obs_encoder_info))

obs-encoder.c

P.S. 函数声明在 obs.h 中

obs.h 中关于编码器的输出函数声明

/* ------------------------------------------------------------------------- */
/* Encoders */EXPORT const char *obs_encoder_get_display_name(const char *id);/*** Creates a video encoder context** @param  id        Video encoder ID* @param  name      Name to assign to this context* @param  settings  Settings* @return           The video encoder context, or NULL if failed or not found.*/
EXPORT obs_encoder_t *obs_video_encoder_create(const char *id, const char *name,obs_data_t *settings,obs_data_t *hotkey_data);/*** Creates an audio encoder context** @param  id        Audio Encoder ID* @param  name      Name to assign to this context* @param  settings  Settings* @param  mixer_idx Index of the mixer to use for this audio encoder* @return           The video encoder context, or NULL if failed or not found.*/
EXPORT obs_encoder_t *obs_audio_encoder_create(const char *id, const char *name,obs_data_t *settings,size_t mixer_idx,obs_data_t *hotkey_data);/*** Adds/releases a reference to an encoder.  When the last reference is* released, the encoder is destroyed.*/
OBS_EXTERNAL_DEPRECATED EXPORT void obs_encoder_addref(obs_encoder_t *encoder);
EXPORT void obs_encoder_release(obs_encoder_t *encoder);EXPORT void obs_weak_encoder_addref(obs_weak_encoder_t *weak);
EXPORT void obs_weak_encoder_release(obs_weak_encoder_t *weak);EXPORT obs_encoder_t *obs_encoder_get_ref(obs_encoder_t *encoder);
EXPORT obs_weak_encoder_t *obs_encoder_get_weak_encoder(obs_encoder_t *encoder);
EXPORT obs_encoder_t *obs_weak_encoder_get_encoder(obs_weak_encoder_t *weak);EXPORT bool obs_weak_encoder_references_encoder(obs_weak_encoder_t *weak,obs_encoder_t *encoder);EXPORT void obs_encoder_set_name(obs_encoder_t *encoder, const char *name);
EXPORT const char *obs_encoder_get_name(const obs_encoder_t *encoder);/** Returns the codec of an encoder by the id */
EXPORT const char *obs_get_encoder_codec(const char *id);/** Returns the type of an encoder by the id */
EXPORT enum obs_encoder_type obs_get_encoder_type(const char *id);/** Returns the codec of the encoder */
EXPORT const char *obs_encoder_get_codec(const obs_encoder_t *encoder);/** Returns the type of an encoder */
EXPORT enum obs_encoder_type obs_encoder_get_type(const obs_encoder_t *encoder);/*** Sets the scaled resolution for a video encoder.  Set width and height to 0* to disable scaling.  If the encoder is active, this function will trigger* a warning, and do nothing.*/
EXPORT void obs_encoder_set_scaled_size(obs_encoder_t *encoder, uint32_t width,uint32_t height);/** For video encoders, returns true if pre-encode scaling is enabled */
EXPORT bool obs_encoder_scaling_enabled(const obs_encoder_t *encoder);/** For video encoders, returns the width of the encoded image */
EXPORT uint32_t obs_encoder_get_width(const obs_encoder_t *encoder);/** For video encoders, returns the height of the encoded image */
EXPORT uint32_t obs_encoder_get_height(const obs_encoder_t *encoder);/** For audio encoders, returns the sample rate of the audio */
EXPORT uint32_t obs_encoder_get_sample_rate(const obs_encoder_t *encoder);/** For audio encoders, returns the frame size of the audio packet */
EXPORT size_t obs_encoder_get_frame_size(const obs_encoder_t *encoder);/*** Sets the preferred video format for a video encoder.  If the encoder can use* the format specified, it will force a conversion to that format if the* obs output format does not match the preferred format.** If the format is set to VIDEO_FORMAT_NONE, will revert to the default* functionality of converting only when absolutely necessary.*/
EXPORT void obs_encoder_set_preferred_video_format(obs_encoder_t *encoder,enum video_format format);
EXPORT enum video_format
obs_encoder_get_preferred_video_format(const obs_encoder_t *encoder);/** Gets the default settings for an encoder type */
EXPORT obs_data_t *obs_encoder_defaults(const char *id);
EXPORT obs_data_t *obs_encoder_get_defaults(const obs_encoder_t *encoder);/** Returns the property list, if any.  Free with obs_properties_destroy */
EXPORT obs_properties_t *obs_get_encoder_properties(const char *id);/*** Returns the property list of an existing encoder, if any.  Free with* obs_properties_destroy*/
EXPORT obs_properties_t *obs_encoder_properties(const obs_encoder_t *encoder);/*** Updates the settings of the encoder context.  Usually used for changing* bitrate while active*/
EXPORT void obs_encoder_update(obs_encoder_t *encoder, obs_data_t *settings);/** Gets extra data (headers) associated with this context */
EXPORT bool obs_encoder_get_extra_data(const obs_encoder_t *encoder,uint8_t **extra_data, size_t *size);/** Returns the current settings for this encoder */
EXPORT obs_data_t *obs_encoder_get_settings(const obs_encoder_t *encoder);/** Sets the video output context to be used with this encoder */
EXPORT void obs_encoder_set_video(obs_encoder_t *encoder, video_t *video);/** Sets the audio output context to be used with this encoder */
EXPORT void obs_encoder_set_audio(obs_encoder_t *encoder, audio_t *audio);/*** Returns the video output context used with this encoder, or NULL if not* a video context*/
EXPORT video_t *obs_encoder_video(const obs_encoder_t *encoder);/*** Returns the audio output context used with this encoder, or NULL if not* a audio context*/
EXPORT audio_t *obs_encoder_audio(const obs_encoder_t *encoder);/** Returns true if encoder is active, false otherwise */
EXPORT bool obs_encoder_active(const obs_encoder_t *encoder);EXPORT void *obs_encoder_get_type_data(obs_encoder_t *encoder);EXPORT const char *obs_encoder_get_id(const obs_encoder_t *encoder);EXPORT uint32_t obs_get_encoder_caps(const char *encoder_id);
EXPORT uint32_t obs_encoder_get_caps(const obs_encoder_t *encoder);#ifndef SWIG
/** Duplicates an encoder packet */
OBS_DEPRECATED
EXPORT void obs_duplicate_encoder_packet(struct encoder_packet *dst,const struct encoder_packet *src);OBS_DEPRECATED
EXPORT void obs_free_encoder_packet(struct encoder_packet *packet);
#endifEXPORT void obs_encoder_packet_ref(struct encoder_packet *dst,struct encoder_packet *src);
EXPORT void obs_encoder_packet_release(struct encoder_packet *packet);EXPORT void *obs_encoder_create_rerouted(obs_encoder_t *encoder,const char *reroute_id);/** Returns whether encoder is paused */
EXPORT bool obs_encoder_paused(const obs_encoder_t *output);EXPORT const char *obs_encoder_get_last_error(obs_encoder_t *encoder);
EXPORT void obs_encoder_set_last_error(obs_encoder_t *encoder,const char *message);EXPORT uint64_t obs_encoder_get_pause_offset(const obs_encoder_t *encoder);/* ------------------------------------------------------------------------- */

obs-internal.h 中内部使用的函数和结构体

/* encoders  */struct obs_weak_encoder {struct obs_weak_ref ref;struct obs_encoder *encoder;
};struct encoder_callback {bool sent_first_packet;void (*new_packet)(void *param, struct encoder_packet *packet);void *param;
};struct obs_encoder {struct obs_context_data context;struct obs_encoder_info info;/* allows re-routing to another encoder */struct obs_encoder_info orig_info;pthread_mutex_t init_mutex;uint32_t samplerate;size_t planes;size_t blocksize;size_t framesize;size_t framesize_bytes;size_t mixer_idx;uint32_t scaled_width;uint32_t scaled_height;enum video_format preferred_format;volatile bool active;volatile bool paused;bool initialized;/* indicates ownership of the info.id buffer */bool owns_info_id;uint32_t timebase_num;uint32_t timebase_den;int64_t cur_pts;struct circlebuf audio_input_buffer[MAX_AV_PLANES];uint8_t *audio_output_buffer[MAX_AV_PLANES];/* if a video encoder is paired with an audio encoder, make it start* up at the specific timestamp.  if this is the audio encoder,* wait_for_video makes it wait until it's ready to sync up with* video */bool wait_for_video;bool first_received;struct obs_encoder *paired_encoder;int64_t offset_usec;uint64_t first_raw_ts;uint64_t start_ts;pthread_mutex_t outputs_mutex;DARRAY(obs_output_t *) outputs;bool destroy_on_stop;/* stores the video/audio media output pointer.  video_t *or audio_t **/void *media;pthread_mutex_t callbacks_mutex;DARRAY(struct encoder_callback) callbacks;struct pause_data pause;const char *profile_encoder_encode_name;char *last_error_message;/* reconfigure encoder at next possible opportunity */bool reconfigure_requested;
};extern struct obs_encoder_info *find_encoder(const char *id);extern bool obs_encoder_initialize(obs_encoder_t *encoder);
extern void obs_encoder_shutdown(obs_encoder_t *encoder);extern void obs_encoder_start(obs_encoder_t *encoder,void (*new_packet)(void *param,struct encoder_packet *packet),void *param);
extern void obs_encoder_stop(obs_encoder_t *encoder,void (*new_packet)(void *param,struct encoder_packet *packet),void *param);extern void obs_encoder_add_output(struct obs_encoder *encoder,struct obs_output *output);
extern void obs_encoder_remove_output(struct obs_encoder *encoder,struct obs_output *output);extern bool start_gpu_encode(obs_encoder_t *encoder);
extern void stop_gpu_encode(obs_encoder_t *encoder);extern bool do_encode(struct obs_encoder *encoder, struct encoder_frame *frame);
extern void send_off_encoder_packet(obs_encoder_t *encoder, bool success,bool received, struct encoder_packet *pkt); // 把编码后数据发送到 output 中void obs_encoder_destroy(obs_encoder_t *encoder);

DARRAY(struct obs_encoder_info) encoder_types; 表示当前注册的编码器

struct obs_core {struct obs_module *first_module;DARRAY(struct obs_module_path) module_paths;DARRAY(struct obs_source_info) source_types;DARRAY(struct obs_source_info) input_types;DARRAY(struct obs_source_info) filter_types;DARRAY(struct obs_source_info) transition_types;DARRAY(struct obs_output_info) output_types;DARRAY(struct obs_encoder_info) encoder_types;DARRAY(struct obs_service_info) service_types;DARRAY(struct obs_modal_ui) modal_ui_callbacks;DARRAY(struct obs_modeless_ui) modeless_ui_callbacks;signal_handler_t *signals;proc_handler_t *procs;char *locale;char *module_config_path;bool name_store_owned;profiler_name_store_t *name_store;/* segmented into multiple sub-structures to keep things a bit more* clean and organized */struct obs_core_video video;struct obs_core_audio audio;struct obs_core_data data;struct obs_core_hotkeys hotkeys;os_task_queue_t *destruction_task_thread;obs_task_handler_t ui_task_handler;
};extern struct obs_core *obs;

obs-encoder.c

/******************************************************************************Copyright (C) 2013-2014 by Hugh Bailey <obs.jim@gmail.com>This program is free software: you can redistribute it and/or modifyit under the terms of the GNU General Public License as published bythe Free Software Foundation, either version 2 of the License, or(at your option) any later version.This program is distributed in the hope that it will be useful,but WITHOUT ANY WARRANTY; without even the implied warranty ofMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See theGNU General Public License for more details.You should have received a copy of the GNU General Public Licensealong with this program.  If not, see <http://www.gnu.org/licenses/>.
******************************************************************************/#include "obs.h"
#include "obs-internal.h"
#include "util/util_uint64.h"#define encoder_active(encoder) os_atomic_load_bool(&encoder->active)
#define set_encoder_active(encoder, val) \os_atomic_set_bool(&encoder->active, val)#define get_weak(encoder) ((obs_weak_encoder_t *)encoder->context.control)struct obs_encoder_info *find_encoder(const char *id)
{for (size_t i = 0; i < obs->encoder_types.num; i++) {struct obs_encoder_info *info = obs->encoder_types.array + i;if (strcmp(info->id, id) == 0)return info;}return NULL;
}const char *obs_encoder_get_display_name(const char *id)
{struct obs_encoder_info *ei = find_encoder(id);return ei ? ei->get_name(ei->type_data) : NULL;
}static bool init_encoder(struct obs_encoder *encoder, const char *name,obs_data_t *settings, obs_data_t *hotkey_data)
{pthread_mutex_init_value(&encoder->init_mutex);pthread_mutex_init_value(&encoder->callbacks_mutex);pthread_mutex_init_value(&encoder->outputs_mutex);pthread_mutex_init_value(&encoder->pause.mutex);if (!obs_context_data_init(&encoder->context, OBS_OBJ_TYPE_ENCODER,settings, name, hotkey_data, false))return false;if (pthread_mutex_init_recursive(&encoder->init_mutex) != 0)return false;if (pthread_mutex_init_recursive(&encoder->callbacks_mutex) != 0)return false;if (pthread_mutex_init(&encoder->outputs_mutex, NULL) != 0)return false;if (pthread_mutex_init(&encoder->pause.mutex, NULL) != 0)return false;if (encoder->orig_info.get_defaults) {encoder->orig_info.get_defaults(encoder->context.settings);}if (encoder->orig_info.get_defaults2) {encoder->orig_info.get_defaults2(encoder->context.settings,encoder->orig_info.type_data);}return true;
}static struct obs_encoder *
create_encoder(const char *id, enum obs_encoder_type type, const char *name,obs_data_t *settings, size_t mixer_idx, obs_data_t *hotkey_data)
{struct obs_encoder *encoder;struct obs_encoder_info *ei = find_encoder(id);bool success;if (ei && ei->type != type)return NULL;encoder = bzalloc(sizeof(struct obs_encoder));encoder->mixer_idx = mixer_idx;if (!ei) {blog(LOG_ERROR, "Encoder ID '%s' not found", id);encoder->info.id = bstrdup(id);encoder->info.type = type;encoder->owns_info_id = true;encoder->orig_info = encoder->info;} else {encoder->info = *ei;encoder->orig_info = *ei;}success = init_encoder(encoder, name, settings, hotkey_data);if (!success) {blog(LOG_ERROR, "creating encoder '%s' (%s) failed", name, id);obs_encoder_destroy(encoder);return NULL;}obs_context_init_control(&encoder->context, encoder,(obs_destroy_cb)obs_encoder_destroy);obs_context_data_insert(&encoder->context, &obs->data.encoders_mutex,&obs->data.first_encoder);blog(LOG_DEBUG, "encoder '%s' (%s) created", name, id);return encoder;
}obs_encoder_t *obs_video_encoder_create(const char *id, const char *name,obs_data_t *settings,obs_data_t *hotkey_data)
{if (!name || !id)return NULL;return create_encoder(id, OBS_ENCODER_VIDEO, name, settings, 0,hotkey_data);
}obs_encoder_t *obs_audio_encoder_create(const char *id, const char *name,obs_data_t *settings, size_t mixer_idx,obs_data_t *hotkey_data)
{if (!name || !id)return NULL;return create_encoder(id, OBS_ENCODER_AUDIO, name, settings, mixer_idx,hotkey_data);
}static void receive_video(void *param, struct video_data *frame);
static void receive_audio(void *param, size_t mix_idx, struct audio_data *data);static inline void get_audio_info(const struct obs_encoder *encoder,struct audio_convert_info *info)
{const struct audio_output_info *aoi;aoi = audio_output_get_info(encoder->media);if (info->format == AUDIO_FORMAT_UNKNOWN)info->format = aoi->format;if (!info->samples_per_sec)info->samples_per_sec = aoi->samples_per_sec;if (info->speakers == SPEAKERS_UNKNOWN)info->speakers = aoi->speakers;if (encoder->info.get_audio_info)encoder->info.get_audio_info(encoder->context.data, info);
}static inline void get_video_info(struct obs_encoder *encoder,struct video_scale_info *info)
{const struct video_output_info *voi;voi = video_output_get_info(encoder->media);info->format = voi->format;info->colorspace = voi->colorspace;info->range = voi->range;info->width = obs_encoder_get_width(encoder);info->height = obs_encoder_get_height(encoder);if (encoder->info.get_video_info)encoder->info.get_video_info(encoder->context.data, info);if (info->width != voi->width || info->height != voi->height)obs_encoder_set_scaled_size(encoder, info->width, info->height);
}static inline bool gpu_encode_available(const struct obs_encoder *encoder)
{struct obs_core_video_mix *video = get_mix_for_video(encoder->media);if (!video)return false;return (encoder->info.caps & OBS_ENCODER_CAP_PASS_TEXTURE) != 0 &&(video->using_p010_tex || video->using_nv12_tex);
}static void add_connection(struct obs_encoder *encoder)
{if (encoder->info.type == OBS_ENCODER_AUDIO) {struct audio_convert_info audio_info = {0};get_audio_info(encoder, &audio_info);audio_output_connect(encoder->media, encoder->mixer_idx,&audio_info, receive_audio, encoder);} else {struct video_scale_info info = {0};get_video_info(encoder, &info);if (gpu_encode_available(encoder)) {start_gpu_encode(encoder);} else {start_raw_video(encoder->media, &info, receive_video,encoder);}}set_encoder_active(encoder, true);
}static void remove_connection(struct obs_encoder *encoder, bool shutdown)
{if (encoder->info.type == OBS_ENCODER_AUDIO) {audio_output_disconnect(encoder->media, encoder->mixer_idx,receive_audio, encoder);} else {if (gpu_encode_available(encoder)) {stop_gpu_encode(encoder);} else {stop_raw_video(encoder->media, receive_video, encoder);}}/* obs_encoder_shutdown locks init_mutex, so don't call it on encode* errors, otherwise you can get a deadlock with outputs when they end* data capture, which will lock init_mutex and the video callback* mutex in the reverse order.  instead, call shutdown before starting* up again */if (shutdown)obs_encoder_shutdown(encoder);set_encoder_active(encoder, false);
}static inline void free_audio_buffers(struct obs_encoder *encoder)
{for (size_t i = 0; i < MAX_AV_PLANES; i++) {circlebuf_free(&encoder->audio_input_buffer[i]);bfree(encoder->audio_output_buffer[i]);encoder->audio_output_buffer[i] = NULL;}
}static void obs_encoder_actually_destroy(obs_encoder_t *encoder)
{if (encoder) {pthread_mutex_lock(&encoder->outputs_mutex);for (size_t i = 0; i < encoder->outputs.num; i++) {struct obs_output *output = encoder->outputs.array[i];obs_output_remove_encoder(output, encoder);}da_free(encoder->outputs);pthread_mutex_unlock(&encoder->outputs_mutex);blog(LOG_DEBUG, "encoder '%s' destroyed",encoder->context.name);free_audio_buffers(encoder);if (encoder->context.data)encoder->info.destroy(encoder->context.data);da_free(encoder->callbacks);pthread_mutex_destroy(&encoder->init_mutex);pthread_mutex_destroy(&encoder->callbacks_mutex);pthread_mutex_destroy(&encoder->outputs_mutex);pthread_mutex_destroy(&encoder->pause.mutex);obs_context_data_free(&encoder->context);if (encoder->owns_info_id)bfree((void *)encoder->info.id);if (encoder->last_error_message)bfree(encoder->last_error_message);bfree(encoder);}
}/* does not actually destroy the encoder until all connections to it have been* removed. (full reference counting really would have been superfluous) */
void obs_encoder_destroy(obs_encoder_t *encoder)
{if (encoder) {bool destroy;obs_context_data_remove(&encoder->context);pthread_mutex_lock(&encoder->init_mutex);pthread_mutex_lock(&encoder->callbacks_mutex);destroy = encoder->callbacks.num == 0;if (!destroy)encoder->destroy_on_stop = true;pthread_mutex_unlock(&encoder->callbacks_mutex);pthread_mutex_unlock(&encoder->init_mutex);if (destroy)obs_encoder_actually_destroy(encoder);}
}const char *obs_encoder_get_name(const obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_get_name")? encoder->context.name: NULL;
}void obs_encoder_set_name(obs_encoder_t *encoder, const char *name)
{if (!obs_encoder_valid(encoder, "obs_encoder_set_name"))return;if (name && *name && strcmp(name, encoder->context.name) != 0)obs_context_data_setname(&encoder->context, name);
}static inline obs_data_t *get_defaults(const struct obs_encoder_info *info)
{obs_data_t *settings = obs_data_create();if (info->get_defaults) {info->get_defaults(settings);}if (info->get_defaults2) {info->get_defaults2(settings, info->type_data);}return settings;
}obs_data_t *obs_encoder_defaults(const char *id)
{const struct obs_encoder_info *info = find_encoder(id);return (info) ? get_defaults(info) : NULL;
}obs_data_t *obs_encoder_get_defaults(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_defaults"))return NULL;return get_defaults(&encoder->info);
}obs_properties_t *obs_get_encoder_properties(const char *id)
{const struct obs_encoder_info *ei = find_encoder(id);if (ei && (ei->get_properties || ei->get_properties2)) {obs_data_t *defaults = get_defaults(ei);obs_properties_t *properties = NULL;if (ei->get_properties2) {properties = ei->get_properties2(NULL, ei->type_data);} else if (ei->get_properties) {properties = ei->get_properties(NULL);}obs_properties_apply_settings(properties, defaults);obs_data_release(defaults);return properties;}return NULL;
}obs_properties_t *obs_encoder_properties(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_properties"))return NULL;if (encoder->orig_info.get_properties2) {obs_properties_t *props;props = encoder->orig_info.get_properties2(encoder->context.data, encoder->orig_info.type_data);obs_properties_apply_settings(props, encoder->context.settings);return props;} else if (encoder->orig_info.get_properties) {obs_properties_t *props;props = encoder->orig_info.get_properties(encoder->context.data);obs_properties_apply_settings(props, encoder->context.settings);return props;}return NULL;
}void obs_encoder_update(obs_encoder_t *encoder, obs_data_t *settings)
{if (!obs_encoder_valid(encoder, "obs_encoder_update"))return;obs_data_apply(encoder->context.settings, settings);// Note, we don't actually apply the changes to the encoder here// as it may be active in another thread. Setting this to true// makes the changes apply at the next possible moment in the// encoder / GPU encoder thread.if (encoder->info.update)encoder->reconfigure_requested = true;
}bool obs_encoder_get_extra_data(const obs_encoder_t *encoder,uint8_t **extra_data, size_t *size)
{if (!obs_encoder_valid(encoder, "obs_encoder_get_extra_data"))return false;if (encoder->info.get_extra_data && encoder->context.data)return encoder->info.get_extra_data(encoder->context.data,extra_data, size);return false;
}obs_data_t *obs_encoder_get_settings(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_get_settings"))return NULL;obs_data_addref(encoder->context.settings);return encoder->context.settings;
}static inline void reset_audio_buffers(struct obs_encoder *encoder)
{free_audio_buffers(encoder);for (size_t i = 0; i < encoder->planes; i++)encoder->audio_output_buffer[i] =bmalloc(encoder->framesize_bytes);
}static void intitialize_audio_encoder(struct obs_encoder *encoder)
{struct audio_convert_info info = {0};get_audio_info(encoder, &info);encoder->samplerate = info.samples_per_sec;encoder->planes = get_audio_planes(info.format, info.speakers);encoder->blocksize = get_audio_size(info.format, info.speakers, 1);encoder->framesize =encoder->info.get_frame_size(encoder->context.data);encoder->framesize_bytes = encoder->blocksize * encoder->framesize;reset_audio_buffers(encoder);
}static THREAD_LOCAL bool can_reroute = false;static inline bool obs_encoder_initialize_internal(obs_encoder_t *encoder)
{if (!encoder->media) {blog(LOG_ERROR,"obs_encoder_initialize_internal: encoder '%s' has no media set",encoder->context.name);return false;}if (encoder_active(encoder))return true;if (encoder->initialized)return true;obs_encoder_shutdown(encoder);if (encoder->orig_info.create) {can_reroute = true;encoder->info = encoder->orig_info;encoder->context.data = encoder->orig_info.create(encoder->context.settings, encoder);can_reroute = false;}if (!encoder->context.data)return false;if (encoder->orig_info.type == OBS_ENCODER_AUDIO)intitialize_audio_encoder(encoder);encoder->initialized = true;return true;
}void *obs_encoder_create_rerouted(obs_encoder_t *encoder,const char *reroute_id)
{if (!obs_ptr_valid(encoder, "obs_encoder_reroute"))return NULL;if (!obs_ptr_valid(reroute_id, "obs_encoder_reroute"))return NULL;if (!can_reroute)return NULL;const struct obs_encoder_info *ei = find_encoder(reroute_id);if (ei) {if (ei->type != encoder->orig_info.type ||astrcmpi(ei->codec, encoder->orig_info.codec) != 0) {return NULL;}encoder->info = *ei;return encoder->info.create(encoder->context.settings, encoder);}return NULL;
}bool obs_encoder_initialize(obs_encoder_t *encoder)
{bool success;if (!encoder)return false;pthread_mutex_lock(&encoder->init_mutex);success = obs_encoder_initialize_internal(encoder);pthread_mutex_unlock(&encoder->init_mutex);return success;
}void obs_encoder_shutdown(obs_encoder_t *encoder)
{pthread_mutex_lock(&encoder->init_mutex);if (encoder->context.data) {encoder->info.destroy(encoder->context.data);encoder->context.data = NULL;encoder->paired_encoder = NULL;encoder->first_received = false;encoder->offset_usec = 0;encoder->start_ts = 0;}obs_encoder_set_last_error(encoder, NULL);pthread_mutex_unlock(&encoder->init_mutex);
}static inline size_t
get_callback_idx(const struct obs_encoder *encoder,void (*new_packet)(void *param, struct encoder_packet *packet),void *param)
{for (size_t i = 0; i < encoder->callbacks.num; i++) {struct encoder_callback *cb = encoder->callbacks.array + i;if (cb->new_packet == new_packet && cb->param == param)return i;}return DARRAY_INVALID;
}void pause_reset(struct pause_data *pause)
{pthread_mutex_lock(&pause->mutex);pause->last_video_ts = 0;pause->ts_start = 0;pause->ts_end = 0;pause->ts_offset = 0;pthread_mutex_unlock(&pause->mutex);
}static inline void obs_encoder_start_internal(obs_encoder_t *encoder,void (*new_packet)(void *param, struct encoder_packet *packet),void *param)
{struct encoder_callback cb = {false, new_packet, param};bool first = false;if (!encoder->context.data || !encoder->media)return;pthread_mutex_lock(&encoder->callbacks_mutex);first = (encoder->callbacks.num == 0);size_t idx = get_callback_idx(encoder, new_packet, param);if (idx == DARRAY_INVALID)da_push_back(encoder->callbacks, &cb);pthread_mutex_unlock(&encoder->callbacks_mutex);if (first) {os_atomic_set_bool(&encoder->paused, false);pause_reset(&encoder->pause);encoder->cur_pts = 0;add_connection(encoder);}
}void obs_encoder_start(obs_encoder_t *encoder,void (*new_packet)(void *param,struct encoder_packet *packet),void *param)
{if (!obs_encoder_valid(encoder, "obs_encoder_start"))return;if (!obs_ptr_valid(new_packet, "obs_encoder_start"))return;pthread_mutex_lock(&encoder->init_mutex);obs_encoder_start_internal(encoder, new_packet, param);pthread_mutex_unlock(&encoder->init_mutex);
}static inline bool obs_encoder_stop_internal(obs_encoder_t *encoder,void (*new_packet)(void *param, struct encoder_packet *packet),void *param)
{bool last = false;size_t idx;pthread_mutex_lock(&encoder->callbacks_mutex);idx = get_callback_idx(encoder, new_packet, param);if (idx != DARRAY_INVALID) {da_erase(encoder->callbacks, idx);last = (encoder->callbacks.num == 0);}pthread_mutex_unlock(&encoder->callbacks_mutex);if (last) {remove_connection(encoder, true);encoder->initialized = false;if (encoder->destroy_on_stop) {pthread_mutex_unlock(&encoder->init_mutex);obs_encoder_actually_destroy(encoder);return true;}}return false;
}void obs_encoder_stop(obs_encoder_t *encoder,void (*new_packet)(void *param,struct encoder_packet *packet),void *param)
{bool destroyed;if (!obs_encoder_valid(encoder, "obs_encoder_stop"))return;if (!obs_ptr_valid(new_packet, "obs_encoder_stop"))return;pthread_mutex_lock(&encoder->init_mutex);destroyed = obs_encoder_stop_internal(encoder, new_packet, param);if (!destroyed)pthread_mutex_unlock(&encoder->init_mutex);
}const char *obs_encoder_get_codec(const obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_get_codec")? encoder->info.codec: NULL;
}const char *obs_get_encoder_codec(const char *id)
{struct obs_encoder_info *info = find_encoder(id);return info ? info->codec : NULL;
}enum obs_encoder_type obs_encoder_get_type(const obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_get_type")? encoder->info.type: OBS_ENCODER_AUDIO;
}enum obs_encoder_type obs_get_encoder_type(const char *id)
{struct obs_encoder_info *info = find_encoder(id);return info ? info->type : OBS_ENCODER_AUDIO;
}void obs_encoder_set_scaled_size(obs_encoder_t *encoder, uint32_t width,uint32_t height)
{if (!obs_encoder_valid(encoder, "obs_encoder_set_scaled_size"))return;if (encoder->info.type != OBS_ENCODER_VIDEO) {blog(LOG_WARNING,"obs_encoder_set_scaled_size: ""encoder '%s' is not a video encoder",obs_encoder_get_name(encoder));return;}if (encoder_active(encoder)) {blog(LOG_WARNING,"encoder '%s': Cannot set the scaled ""resolution while the encoder is active",obs_encoder_get_name(encoder));return;}encoder->scaled_width = width;encoder->scaled_height = height;
}bool obs_encoder_scaling_enabled(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_scaling_enabled"))return false;return encoder->scaled_width || encoder->scaled_height;
}uint32_t obs_encoder_get_width(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_get_width"))return 0;if (encoder->info.type != OBS_ENCODER_VIDEO) {blog(LOG_WARNING,"obs_encoder_get_width: ""encoder '%s' is not a video encoder",obs_encoder_get_name(encoder));return 0;}if (!encoder->media)return 0;return encoder->scaled_width != 0? encoder->scaled_width: video_output_get_width(encoder->media);
}uint32_t obs_encoder_get_height(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_get_height"))return 0;if (encoder->info.type != OBS_ENCODER_VIDEO) {blog(LOG_WARNING,"obs_encoder_get_height: ""encoder '%s' is not a video encoder",obs_encoder_get_name(encoder));return 0;}if (!encoder->media)return 0;return encoder->scaled_height != 0? encoder->scaled_height: video_output_get_height(encoder->media);
}uint32_t obs_encoder_get_sample_rate(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_get_sample_rate"))return 0;if (encoder->info.type != OBS_ENCODER_AUDIO) {blog(LOG_WARNING,"obs_encoder_get_sample_rate: ""encoder '%s' is not an audio encoder",obs_encoder_get_name(encoder));return 0;}if (!encoder->media)return 0;return encoder->samplerate != 0? encoder->samplerate: audio_output_get_sample_rate(encoder->media);
}size_t obs_encoder_get_frame_size(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_get_frame_size"))return 0;if (encoder->info.type != OBS_ENCODER_AUDIO) {blog(LOG_WARNING,"obs_encoder_get_frame_size: ""encoder '%s' is not an audio encoder",obs_encoder_get_name(encoder));return 0;}return encoder->framesize;
}void obs_encoder_set_video(obs_encoder_t *encoder, video_t *video)
{const struct video_output_info *voi;if (!obs_encoder_valid(encoder, "obs_encoder_set_video"))return;if (encoder->info.type != OBS_ENCODER_VIDEO) {blog(LOG_WARNING,"obs_encoder_set_video: ""encoder '%s' is not a video encoder",obs_encoder_get_name(encoder));return;}if (encoder_active(encoder)) {blog(LOG_WARNING,"encoder '%s': Cannot apply a new video_t ""object while the encoder is active",obs_encoder_get_name(encoder));return;}if (video) {voi = video_output_get_info(video);encoder->media = video;encoder->timebase_num = voi->fps_den;encoder->timebase_den = voi->fps_num;} else {encoder->media = NULL;encoder->timebase_num = 0;encoder->timebase_den = 0;}
}void obs_encoder_set_audio(obs_encoder_t *encoder, audio_t *audio)
{if (!obs_encoder_valid(encoder, "obs_encoder_set_audio"))return;if (encoder->info.type != OBS_ENCODER_AUDIO) {blog(LOG_WARNING,"obs_encoder_set_audio: ""encoder '%s' is not an audio encoder",obs_encoder_get_name(encoder));return;}if (encoder_active(encoder)) {blog(LOG_WARNING,"encoder '%s': Cannot apply a new audio_t ""object while the encoder is active",obs_encoder_get_name(encoder));return;}if (audio) {encoder->media = audio;encoder->timebase_num = 1;encoder->timebase_den = audio_output_get_sample_rate(audio);} else {encoder->media = NULL;encoder->timebase_num = 0;encoder->timebase_den = 0;}
}video_t *obs_encoder_video(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_video"))return NULL;if (encoder->info.type != OBS_ENCODER_VIDEO) {blog(LOG_WARNING,"obs_encoder_set_video: ""encoder '%s' is not a video encoder",obs_encoder_get_name(encoder));return NULL;}return encoder->media;
}audio_t *obs_encoder_audio(const obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_audio"))return NULL;if (encoder->info.type != OBS_ENCODER_AUDIO) {blog(LOG_WARNING,"obs_encoder_set_audio: ""encoder '%s' is not an audio encoder",obs_encoder_get_name(encoder));return NULL;}return encoder->media;
}bool obs_encoder_active(const obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_active")? encoder_active(encoder): false;
}static inline bool get_sei(const struct obs_encoder *encoder, uint8_t **sei,size_t *size)
{if (encoder->info.get_sei_data)return encoder->info.get_sei_data(encoder->context.data, sei,size);return false;
}static void send_first_video_packet(struct obs_encoder *encoder,struct encoder_callback *cb,struct encoder_packet *packet)
{struct encoder_packet first_packet;DARRAY(uint8_t) data;uint8_t *sei;size_t size;/* always wait for first keyframe */if (!packet->keyframe)return;da_init(data);if (!get_sei(encoder, &sei, &size) || !sei || !size) {cb->new_packet(cb->param, packet);cb->sent_first_packet = true;return;}da_push_back_array(data, sei, size);da_push_back_array(data, packet->data, packet->size);first_packet = *packet;first_packet.data = data.array;first_packet.size = data.num;cb->new_packet(cb->param, &first_packet);cb->sent_first_packet = true;da_free(data);
}static const char *send_packet_name = "send_packet";
static inline void send_packet(struct obs_encoder *encoder,struct encoder_callback *cb,struct encoder_packet *packet)
{profile_start(send_packet_name);/* include SEI in first video packet */if (encoder->info.type == OBS_ENCODER_VIDEO && !cb->sent_first_packet)send_first_video_packet(encoder, cb, packet);elsecb->new_packet(cb->param, packet);profile_end(send_packet_name);
}void full_stop(struct obs_encoder *encoder)
{if (encoder) {pthread_mutex_lock(&encoder->outputs_mutex);for (size_t i = 0; i < encoder->outputs.num; i++) {struct obs_output *output = encoder->outputs.array[i];obs_output_force_stop(output);pthread_mutex_lock(&output->interleaved_mutex);output->info.encoded_packet(output->context.data, NULL);pthread_mutex_unlock(&output->interleaved_mutex);}pthread_mutex_unlock(&encoder->outputs_mutex);pthread_mutex_lock(&encoder->callbacks_mutex);da_free(encoder->callbacks);pthread_mutex_unlock(&encoder->callbacks_mutex);remove_connection(encoder, false);encoder->initialized = false;}
}void send_off_encoder_packet(obs_encoder_t *encoder, bool success,bool received, struct encoder_packet *pkt)
{if (!success) {blog(LOG_ERROR, "Error encoding with encoder '%s'",encoder->context.name);full_stop(encoder);return;}if (received) {if (!encoder->first_received) {encoder->offset_usec = packet_dts_usec(pkt);encoder->first_received = true;}/* we use system time here to ensure sync with other encoders,* you do not want to use relative timestamps here */pkt->dts_usec = encoder->start_ts / 1000 +packet_dts_usec(pkt) - encoder->offset_usec;pkt->sys_dts_usec = pkt->dts_usec;pthread_mutex_lock(&encoder->pause.mutex);pkt->sys_dts_usec += encoder->pause.ts_offset / 1000;pthread_mutex_unlock(&encoder->pause.mutex);pthread_mutex_lock(&encoder->callbacks_mutex);for (size_t i = encoder->callbacks.num; i > 0; i--) {struct encoder_callback *cb;cb = encoder->callbacks.array + (i - 1);send_packet(encoder, cb, pkt);}pthread_mutex_unlock(&encoder->callbacks_mutex);}
}static const char *do_encode_name = "do_encode";
bool do_encode(struct obs_encoder *encoder, struct encoder_frame *frame)
{profile_start(do_encode_name);if (!encoder->profile_encoder_encode_name)encoder->profile_encoder_encode_name =profile_store_name(obs_get_profiler_name_store(),"encode(%s)", encoder->context.name);struct encoder_packet pkt = {0};bool received = false;bool success;if (encoder->reconfigure_requested) {encoder->reconfigure_requested = false;encoder->info.update(encoder->context.data,encoder->context.settings);}pkt.timebase_num = encoder->timebase_num;pkt.timebase_den = encoder->timebase_den;pkt.encoder = encoder;profile_start(encoder->profile_encoder_encode_name);success = encoder->info.encode(encoder->context.data, frame, &pkt,&received);profile_end(encoder->profile_encoder_encode_name);send_off_encoder_packet(encoder, success, received, &pkt);profile_end(do_encode_name);return success;
}static inline bool video_pause_check_internal(struct pause_data *pause,uint64_t ts)
{pause->last_video_ts = ts;if (!pause->ts_start) {return false;}if (ts == pause->ts_end) {pause->ts_start = 0;pause->ts_end = 0;} else if (ts >= pause->ts_start) {return true;}return false;
}bool video_pause_check(struct pause_data *pause, uint64_t timestamp)
{bool ignore_frame;pthread_mutex_lock(&pause->mutex);ignore_frame = video_pause_check_internal(pause, timestamp);pthread_mutex_unlock(&pause->mutex);return ignore_frame;
}static const char *receive_video_name = "receive_video";
static void receive_video(void *param, struct video_data *frame)
{profile_start(receive_video_name);struct obs_encoder *encoder = param;struct obs_encoder *pair = encoder->paired_encoder;struct encoder_frame enc_frame;if (!encoder->first_received && pair) {if (!pair->first_received ||pair->first_raw_ts > frame->timestamp) {goto wait_for_audio;}}if (video_pause_check(&encoder->pause, frame->timestamp))goto wait_for_audio;memset(&enc_frame, 0, sizeof(struct encoder_frame));for (size_t i = 0; i < MAX_AV_PLANES; i++) {enc_frame.data[i] = frame->data[i];enc_frame.linesize[i] = frame->linesize[i];}if (!encoder->start_ts)encoder->start_ts = frame->timestamp;enc_frame.frames = 1;enc_frame.pts = encoder->cur_pts;if (do_encode(encoder, &enc_frame))encoder->cur_pts += encoder->timebase_num;wait_for_audio:profile_end(receive_video_name);
}static void clear_audio(struct obs_encoder *encoder)
{for (size_t i = 0; i < encoder->planes; i++)circlebuf_free(&encoder->audio_input_buffer[i]);
}static inline void push_back_audio(struct obs_encoder *encoder,struct audio_data *data, size_t size,size_t offset_size)
{if (offset_size >= size)return;size -= offset_size;/* push in to the circular buffer */for (size_t i = 0; i < encoder->planes; i++)circlebuf_push_back(&encoder->audio_input_buffer[i],data->data[i] + offset_size, size);
}static inline size_t calc_offset_size(struct obs_encoder *encoder,uint64_t v_start_ts, uint64_t a_start_ts)
{uint64_t offset = v_start_ts - a_start_ts;offset = util_mul_div64(offset, encoder->samplerate, 1000000000ULL);return (size_t)offset * encoder->blocksize;
}static void start_from_buffer(struct obs_encoder *encoder, uint64_t v_start_ts)
{size_t size = encoder->audio_input_buffer[0].size;struct audio_data audio = {0};size_t offset_size = 0;for (size_t i = 0; i < MAX_AV_PLANES; i++) {audio.data[i] = encoder->audio_input_buffer[i].data;memset(&encoder->audio_input_buffer[i], 0,sizeof(struct circlebuf));}if (encoder->first_raw_ts < v_start_ts)offset_size = calc_offset_size(encoder, v_start_ts,encoder->first_raw_ts);push_back_audio(encoder, &audio, size, offset_size);for (size_t i = 0; i < MAX_AV_PLANES; i++)bfree(audio.data[i]);
}static const char *buffer_audio_name = "buffer_audio";
static bool buffer_audio(struct obs_encoder *encoder, struct audio_data *data)
{profile_start(buffer_audio_name);size_t size = data->frames * encoder->blocksize;size_t offset_size = 0;bool success = true;if (!encoder->start_ts && encoder->paired_encoder) {uint64_t end_ts = data->timestamp;uint64_t v_start_ts = encoder->paired_encoder->start_ts;/* no video yet, so don't start audio */if (!v_start_ts) {success = false;goto fail;}/* audio starting point still not synced with video starting* point, so don't start audio */end_ts += util_mul_div64(data->frames, 1000000000ULL,encoder->samplerate);if (end_ts <= v_start_ts) {success = false;goto fail;}/* ready to start audio, truncate if necessary */if (data->timestamp < v_start_ts)offset_size = calc_offset_size(encoder, v_start_ts,data->timestamp);if (data->timestamp <= v_start_ts)clear_audio(encoder);encoder->start_ts = v_start_ts;/* use currently buffered audio instead */if (v_start_ts < data->timestamp) {start_from_buffer(encoder, v_start_ts);}} else if (!encoder->start_ts && !encoder->paired_encoder) {encoder->start_ts = data->timestamp;}fail:push_back_audio(encoder, data, size, offset_size);profile_end(buffer_audio_name);return success;
}static bool send_audio_data(struct obs_encoder *encoder)
{struct encoder_frame enc_frame;memset(&enc_frame, 0, sizeof(struct encoder_frame));for (size_t i = 0; i < encoder->planes; i++) {circlebuf_pop_front(&encoder->audio_input_buffer[i],encoder->audio_output_buffer[i],encoder->framesize_bytes);enc_frame.data[i] = encoder->audio_output_buffer[i];enc_frame.linesize[i] = (uint32_t)encoder->framesize_bytes;}enc_frame.frames = (uint32_t)encoder->framesize;enc_frame.pts = encoder->cur_pts;if (!do_encode(encoder, &enc_frame))return false;encoder->cur_pts += encoder->framesize;return true;
}static void pause_audio(struct pause_data *pause, struct audio_data *data,size_t sample_rate)
{uint64_t cutoff_frames = pause->ts_start - data->timestamp;cutoff_frames = ns_to_audio_frames(sample_rate, cutoff_frames);data->frames = (uint32_t)cutoff_frames;
}static void unpause_audio(struct pause_data *pause, struct audio_data *data,size_t sample_rate)
{uint64_t cutoff_frames = pause->ts_end - data->timestamp;cutoff_frames = ns_to_audio_frames(sample_rate, cutoff_frames);for (size_t i = 0; i < MAX_AV_PLANES; i++) {if (!data->data[i])break;data->data[i] += cutoff_frames * sizeof(float);}data->timestamp = pause->ts_start;data->frames = data->frames - (uint32_t)cutoff_frames;pause->ts_start = 0;pause->ts_end = 0;
}static inline bool audio_pause_check_internal(struct pause_data *pause,struct audio_data *data,size_t sample_rate)
{uint64_t end_ts;if (!pause->ts_start) {return false;}end_ts =data->timestamp + audio_frames_to_ns(sample_rate, data->frames);if (pause->ts_start >= data->timestamp) {if (pause->ts_start <= end_ts) {pause_audio(pause, data, sample_rate);return !data->frames;}} else {if (pause->ts_end >= data->timestamp &&pause->ts_end <= end_ts) {unpause_audio(pause, data, sample_rate);return !data->frames;}return true;}return false;
}bool audio_pause_check(struct pause_data *pause, struct audio_data *data,size_t sample_rate)
{bool ignore_audio;pthread_mutex_lock(&pause->mutex);ignore_audio = audio_pause_check_internal(pause, data, sample_rate);data->timestamp -= pause->ts_offset;pthread_mutex_unlock(&pause->mutex);return ignore_audio;
}static const char *receive_audio_name = "receive_audio";
static void receive_audio(void *param, size_t mix_idx, struct audio_data *in)
{profile_start(receive_audio_name);struct obs_encoder *encoder = param;struct audio_data audio = *in;if (!encoder->first_received) {encoder->first_raw_ts = audio.timestamp;encoder->first_received = true;clear_audio(encoder);}if (audio_pause_check(&encoder->pause, &audio, encoder->samplerate))goto end;if (!buffer_audio(encoder, &audio))goto end;while (encoder->audio_input_buffer[0].size >=encoder->framesize_bytes) {if (!send_audio_data(encoder)) {break;}}UNUSED_PARAMETER(mix_idx);end:profile_end(receive_audio_name);
}void obs_encoder_add_output(struct obs_encoder *encoder,struct obs_output *output)
{if (!encoder || !output)return;pthread_mutex_lock(&encoder->outputs_mutex);da_push_back(encoder->outputs, &output);pthread_mutex_unlock(&encoder->outputs_mutex);
}void obs_encoder_remove_output(struct obs_encoder *encoder,struct obs_output *output)
{if (!encoder || !output)return;pthread_mutex_lock(&encoder->outputs_mutex);da_erase_item(encoder->outputs, &output);pthread_mutex_unlock(&encoder->outputs_mutex);
}void obs_encoder_packet_create_instance(struct encoder_packet *dst,const struct encoder_packet *src)
{long *p_refs;*dst = *src;p_refs = bmalloc(src->size + sizeof(long));dst->data = (void *)(p_refs + 1);*p_refs = 1;memcpy(dst->data, src->data, src->size);
}/* OBS_DEPRECATED */
void obs_duplicate_encoder_packet(struct encoder_packet *dst,const struct encoder_packet *src)
{obs_encoder_packet_create_instance(dst, src);
}/* OBS_DEPRECATED */
void obs_free_encoder_packet(struct encoder_packet *packet)
{obs_encoder_packet_release(packet);
}void obs_encoder_packet_ref(struct encoder_packet *dst,struct encoder_packet *src)
{if (!src)return;if (src->data) {long *p_refs = ((long *)src->data) - 1;os_atomic_inc_long(p_refs);}*dst = *src;
}void obs_encoder_packet_release(struct encoder_packet *pkt)
{if (!pkt)return;if (pkt->data) {long *p_refs = ((long *)pkt->data) - 1;if (os_atomic_dec_long(p_refs) == 0)bfree(p_refs);}memset(pkt, 0, sizeof(struct encoder_packet));
}void obs_encoder_set_preferred_video_format(obs_encoder_t *encoder,enum video_format format)
{if (!encoder || encoder->info.type != OBS_ENCODER_VIDEO)return;encoder->preferred_format = format;
}enum video_format
obs_encoder_get_preferred_video_format(const obs_encoder_t *encoder)
{if (!encoder || encoder->info.type != OBS_ENCODER_VIDEO)return VIDEO_FORMAT_NONE;return encoder->preferred_format;
}void obs_encoder_addref(obs_encoder_t *encoder)
{if (!encoder)return;obs_ref_addref(&encoder->context.control->ref);
}void obs_encoder_release(obs_encoder_t *encoder)
{if (!encoder)return;obs_weak_encoder_t *control = get_weak(encoder);if (obs_ref_release(&control->ref)) {// The order of operations is important here since// get_context_by_name in obs.c relies on weak refs// being alive while the context is listedobs_encoder_destroy(encoder);obs_weak_encoder_release(control);}
}void obs_weak_encoder_addref(obs_weak_encoder_t *weak)
{if (!weak)return;obs_weak_ref_addref(&weak->ref);
}void obs_weak_encoder_release(obs_weak_encoder_t *weak)
{if (!weak)return;if (obs_weak_ref_release(&weak->ref))bfree(weak);
}obs_encoder_t *obs_encoder_get_ref(obs_encoder_t *encoder)
{if (!encoder)return NULL;return obs_weak_encoder_get_encoder(get_weak(encoder));
}obs_weak_encoder_t *obs_encoder_get_weak_encoder(obs_encoder_t *encoder)
{if (!encoder)return NULL;obs_weak_encoder_t *weak = get_weak(encoder);obs_weak_encoder_addref(weak);return weak;
}obs_encoder_t *obs_weak_encoder_get_encoder(obs_weak_encoder_t *weak)
{if (!weak)return NULL;if (obs_weak_ref_get_ref(&weak->ref))return weak->encoder;return NULL;
}bool obs_weak_encoder_references_encoder(obs_weak_encoder_t *weak,obs_encoder_t *encoder)
{return weak && encoder && weak->encoder == encoder;
}void *obs_encoder_get_type_data(obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_get_type_data")? encoder->orig_info.type_data: NULL;
}const char *obs_encoder_get_id(const obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_get_id")? encoder->orig_info.id: NULL;
}uint32_t obs_get_encoder_caps(const char *encoder_id)
{struct obs_encoder_info *info = find_encoder(encoder_id);return info ? info->caps : 0;
}uint32_t obs_encoder_get_caps(const obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_get_caps")? encoder->orig_info.caps: 0;
}bool obs_encoder_paused(const obs_encoder_t *encoder)
{return obs_encoder_valid(encoder, "obs_encoder_paused")? os_atomic_load_bool(&encoder->paused): false;
}const char *obs_encoder_get_last_error(obs_encoder_t *encoder)
{if (!obs_encoder_valid(encoder, "obs_encoder_get_last_error"))return NULL;return encoder->last_error_message;
}void obs_encoder_set_last_error(obs_encoder_t *encoder, const char *message)
{if (!obs_encoder_valid(encoder, "obs_encoder_set_last_error"))return;if (encoder->last_error_message)bfree(encoder->last_error_message);if (message)encoder->last_error_message = bstrdup(message);elseencoder->last_error_message = NULL;
}uint64_t obs_encoder_get_pause_offset(const obs_encoder_t *encoder)
{return encoder ? encoder->pause.ts_offset : 0;
}

基本操作

创建编码器 obs_video_encoder_create;设置编码器的输入 obs_encoder_set_video/obs_encoder_set_audio;设置编码器的输出 obs_encoder_add_output(output 主动来调用的)

本文来自互联网用户投稿,该文观点仅代表作者本人,不代表本站立场。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如若转载,请注明出处:http://www.mzph.cn/pingmian/13659.shtml

如若内容造成侵权/违法违规/事实不符,请联系多彩编程网进行投诉反馈email:809451989@qq.com,一经查实,立即删除!

相关文章

芯片设计公司外协ERP数字化运营:科技与管理的融合

随着信息技术的快速发展&#xff0c;ERP(企业资源计划)系统已经成为现代企业管理不可或缺的一部分。在芯片设计行业&#xff0c;由于产品的复杂性、技术的高要求以及市场的快速变化&#xff0c;外协ERP数字化运营显得尤为重要。 芯片设计公司的外协ERP数字化运营&#xff0c;主…

xxe漏洞--xml外部实体注入漏洞

1.xxe漏洞介绍 XXE&#xff08;XML External Entity Injection&#xff09;是一种攻击技术&#xff0c;它允许攻击者注入恶意的外部实体到XML文档中。如果应用程序处理XML输入时未正确配置&#xff0c;攻击者可以利用这个漏洞访问受影响系统上的敏感文件、执行远程代码、探测内…

AI大模型知识库与向量数据库:解锁智能问答新时代

随着AI技术的飞速发展&#xff0c;我们的世界正在经历一场前所未有的智能化变革。在这个变革中&#xff0c;AI大模型知识库与向量数据库的完美结合&#xff0c;为知识查询和用户问答领域带来了全新的体验。它们不仅提高了效率&#xff0c;更让问答变得智能、个性化&#xff0c;…

晶体振荡器

一、晶振与晶体区别 晶振是有源晶振的简称&#xff0c;又叫振荡器&#xff0c;英文名称是oscillator&#xff0c;内部有时钟电路&#xff0c;只需供电便可产生振荡信号&#xff1b;晶体是无源晶振的简称&#xff0c;也叫谐振器&#xff0c;英文名称是crystal&#xff0c;是无极…

机械臂与Realsense D435 相机的手眼标定ROS包

本教程主要介绍机械臂与 Realsense D435 相机手眼标定的配置及方法。 系统&#xff1a;Ubuntu 20.0.4 ◼ ROS&#xff1a;Noetic ◼ OpenCV 库&#xff1a;OpenCV 4.2.0 ◼ Realsense D435&#xff1a;librealsense sdk&#xff08;2.50.0&#xff09;、realsense-ros 功能包&…

Kafka-文件存储机制

Kafka概述 Kafka-文件存储机制 1. 分区&#xff1a; Kafka中的每个主题&#xff08;topic&#xff09;都可以分成一个或多个分区。 Topic是逻辑上的概念&#xff0c;而Partition是物理上的概念。 分区是消息的基本单元&#xff0c;每个分区都是一个有序的log日志文件。 Pr…

Linux网络配置全攻略:解读/etc/network/interfaces文件的精髓

欢迎来到我的博客&#xff0c;代码的世界里&#xff0c;每一行都是一个故事 Linux网络配置全攻略&#xff1a;解读/etc/network/interfaces文件的精髓 前言文件结构与基本概念配置网络接口的常用参数高级网络配置技巧实用工具与调试技巧实战案例与最佳实践 前言 在我们的日常生…

【数据库基础】基本认识数据库--入门引导

文章目录 什么是数据库&#xff1f;主流数据库基本使用安装MySQL连接服务器服务器、数据库、表关系使用案例数据逻辑存储 MySQL架构SQL语句分类什么叫存储引擎 什么是数据库&#xff1f; 数据库是指在磁盘和内存中存储特定结构组织的数据。数据库通常用于存储于某个系统、组织或…

整理好了!2024年最常见 20 道 Redis面试题(三)

上一篇地址&#xff1a;整理好了&#xff01;2024年最常见 20 道 Redis面试题&#xff08;二&#xff09;-CSDN博客 五、Redis 的持久化机制有哪些&#xff1f; Redis 是一个内存中的数据结构存储系统&#xff0c;它支持多种类型的数据结构&#xff0c;如字符串、哈希、列表、…

Kylin系列

Kylin是一个开源的分布式分析引擎&#xff0c;主要用于在Hadoop/Spark等大数据平台上提供高性能的SQL查询接口和OLAP&#xff08;联机分析处理&#xff09;能力&#xff0c;以支持超大规模数据的查询和分析。以下是关于Kylin系列的详细解释&#xff1a; 基本概念与原理&#x…

基于springboot实现的校园博客系统

开发语言&#xff1a;Java 框架&#xff1a;springboot JDK版本&#xff1a;JDK1.8 服务器&#xff1a;tomcat7 数据库&#xff1a;mysql 5.7&#xff08;一定要5.7版本&#xff09; 数据库工具&#xff1a;Navicat11 开发软件&#xff1a;eclipse/myeclipse/idea Maven…

Mac SourceTree配置ssh git仓库

一、准备条件 1、Mac系统电脑 2、安装好SourceTree 3、获取ssh git仓库地址 二、配置步骤 1、打开终端命令行 ssh -t rsa -C "xxx""xxx"代表注册git仓库时&#xff0c;使用的用户名&#xff0c;可以是字符串也可以是邮箱地址。 如果遇到输入密码&#xf…

c语言如何向文件读取字符串

如何在c语言中&#xff0c;读取文件&#xff0c;不用一个字符一个字符的读取&#xff0c;而是整个读取字符串 这里就用到fgets语句 fgets(str,n,fp) 它的功能是从fp指向的文件里读取一个长度为n-1的字符串&#xff0c;并一次性存入到str字符数组里&#xff0c;如果成功就返回…

Java Memorandum

Java Memorandum 1 定义安全的集合2 collection集合用迭代器删除元素时避免并发修改异常3 异常捕获4 RequestBody和RequestParam和Parameter区别4.1 RequestBody4.2 RequestParam4.3 Parameter 1 定义安全的集合 void old() {ArrayList<Apple> apples new ArrayList<…

无线网络安全技术基础

无线网络安全技术基础 无线网络安全风险和隐患 随着无线网络技术广泛应用,其安全性越来越引起关注.无线网络的安全主要有访问控制和数据加密,访问控制保证机密数据只能由授权用户访问,而数据加密则要求发送的数据只能被授权用户所接受和使用。 无线网络在数据传输时以微波进…

解决:git每次push or pull都要输入用户名和密码

到git工作目录执行以下命令 git config --global credential.helper store 然后再重新执行一次git pull,这次它还是提示你输入账号和密码&#xff0c;这次之后&#xff0c;它就会记录下账号和密码。以后再pull 或者push的时候&#xff0c;再也不用输入账户和密码了&#xff0…

数据访问层设计_6.连接对象管理设计

1.数据库连接管理 在基于JDBC的数据库应用开发中&#xff0c;数据库连接的管理是一个难点&#xff0c;因为它是决定该应用性能的一个重要因素。 对于共享资源&#xff0c;有一个很著名的设计模式——资源池。该模式正是为了解决资源频繁分配、释放所造成的问题。把该模式应用到…

Centos7.9安装卸载Docker

文章目录 1、官网安装1.1、卸载旧版本Docker1.2、通过rpm仓库安装1.2.1、设置仓库1.2.2、安装Docker Engine1.2.3、启动Docker1.2.4、验证安装 1.3、通过rpm软件包安装1.4、通过便捷脚本安装 2、yum安装2.1、安装docker-ce以及客户端2.2、启动docker2.3、配置镜像加速 3、卸载D…

Dubbo的发展历程与项目背景

项目背景 Dubbo起源于阿里巴巴内部&#xff0c;最初是为了解决日益增长的分布式服务调用需求而诞生的。在2011年前后&#xff0c;随着阿里巴巴集团业务的快速扩张&#xff0c;系统规模不断增大&#xff0c;传统的单体架构难以满足高并发、高可用的服务需求。因此&#xff0c;阿…

Linux安装刻录软件

在工作场景经常使用光盘和刻录机&#xff0c;在windows系统下有nero软件&#xff0c;在linux下有k3b,但是原始的k3b只能一次刻录&#xff0c;十分浪费光盘&#xff0c;这里我们使用经优麒麟优化过的刻录软件&#xff0c;实现多次追加刻录。 进入优麒麟软件仓库&#xff0c;需要…