Snap Patente

A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.

A personalized emoji dictionary, such as for use with emoji-first messaging. Text messaging is automatically converted to emojis by an emoji-first application so that only emojis are communicated from one client device to another client device. Each client device has a personalized emoji library of emojis that are mapped to words, which libraries are customizable and unique to the users of the client devices, such that the users can communicate secretly in code. Upon receipt of a string of emojis, a user can select the emoji string to convert to text if desired, for a predetermined period of time.

An assembly of mechanical components includes a solder joint between two metal components. A mounted component is retained on one side of a support structure by a solder joint on the other side of the support structure between a retainer and a connector that is fast with the mounted component and extends through the support structure. The retainer is of sheet metal construction, so that a height of the solder joint is no more than the thickness of the retainer, thus providing a low-profile joint.

Systems and methods are provided for receiving an ephemeral message, generating an event overlay interface, causing the event overlay interface to be overlaid on top of the ephemeral message, and receiving a selection of an event overlay component via the event overlay interface. The systems and method are also provided for generating a modified event overlay component based on the added plurality of event overlay content, causing the modified event overlay component to be overlaid on top of the ephemeral message, and transmitting the ephemeral message comprising the overlaid modified event overlay component.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.

Systems, computer readable medium and methods for unlocking an autonomous drone are disclosed. Example methods include receiving an indication of a selection of a fly instruction, capturing an image using an image capturing device of the autonomous drone, processing the image to determine whether a face is present in the image, and if the face is present in the image, taking off. The face has to be within a predetermined distance of the autonomous drone. This ensures that the face is likely from the person that selected the fly instruction and ensures that the autonomous drone is far enough away from the face that the autonomous drone will not crash into the face on take-off. In some examples, the autonomous drone determines whether the autonomous drone is sitting on a hand before taking off. The autonomous drone uses a position of the face to determine an initial flight plan.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for video synthesis. The program and method provide for accessing a primary generative adversarial network (GAN) comprising a pre-trained image generator, a motion generator comprising a plurality of neural networks, and a video discriminator; generating an updated GAN based on the primary GAN, by performing operations comprising identifying input data of the updated GAN, the input data comprising an initial latent code and a motion domain dataset, training the motion generator based on the input data, and adjusting weights of the plurality of neural networks of the primary GAN based on an output of the video discriminator; and generating a synthesized video based on the primary GAN and the input data.

Systems and methods are provided for performing operations comprising: displaying one or more virtual objects on an eyewear device; detecting, by a camera of the eyewear device, a hand within view of the eyewear device; determining that a first finger of the hand is oriented along a same direction as the one or more virtual objects that are displayed; detecting movement of a second finger of the hand relative to the first finger; and controlling the display of the one or more virtual objects in response to detecting movement of the second finger to the first finger.

Eyewear having a frame, a hinge, and a hyperextendable temple having a flexible printed circuit (FPC) including service loops. An extender is coupled to the hinge and the temple, and the extender extends with respect to the hinge allowing hyperextension of the temple with respect to the frame. A first service loop allows extension of the FPC when the temple rotates about the hinge, and a second service loop allows the temple to be radially extended away from the hinge.

A map-based graphical user interface for a social media application displays to special social media activity information based on submission of geo-tagged social media items to the platform. For users and or submitted items that need predefined location fuzzing criteria, such activity is represented in the graphical user interface at an intentionally inaccurate position.

Disclosed are systems and methods for face reenactment. An example method may comprise receiving (505) a target video. The target video may include at least one target frame. The at least one target frame may include a target face. The method may also comprise receiving (510) a scenario including a series of source facial expressions. The method may comprise determining (515), based on the target face in the at least one frame of the target video, one or more target facial expressions. Further, the method may comprise synthesizing (525), using a parametric face model and a texture model, an output face. The output face may include the target face. The one or more target facial expressions may be modified to imitate the source facial expressions of the series of source facial expressions. The method may comprise generating (530), based on a deep neural network and at least one previous frame of the target video, a mouth region and an eyes region. Further, the method may comprise combining (535) the output face, the mouth region, and the eyes region to generate a frame of an output video.

In one or more implementations, a user of a client application may share the location of the user in relation to an avatar of the user. In various examples, an avatar-based location sharing user interface element may be selectable to execute an augmented reality content item that is executable to make the location of the user accessible to one or more additional users of the client application. In one or more examples, a message may be generated that includes user content captured at a location of the user, an avatar of the user, and location information related to the location of the user. In one or more additional examples, the location of the user may be accessible via a map user interface that displays the avatar of the user at the location of the user within a geographic region.

Provided are systems and methods for photorealistic real-time portrait animation. An example method comprises receiving a scenario video. The scenario video includes at least one input frame. The at least one input frame includes a first face of a first person. The method further comprises receiving a target image (125). The target image (125) includes a second face (140) of a second person. The method comprises determining, based on the at least one input frame and the target image (125), two-dimensional, 2D, deformations of the second face (140) and a background (145) in the target image (125). The 2D deformations when applied to the second face (140), modify the second face (140) to imitate at least a facial expression and a head orientation of the first face (130). The method also comprises applying the 2D deformations to the target image (125) to obtain at least one output frame of an output video.

A method for adjusting camera intrinsic parameters of a single camera visual tracking device is described. In one aspect, a method includes accessing a temperature of a camera of the visual tracking system, detecting that the temperature of the camera exceeds a threshold, in response identifying one or more feature points that are located in a central region of an initial image, generating a graphical user interface element that instructs a user of the visual tracking system to move the visual tracking system towards a border region of the initial image, and determining intrinsic parameters of the camera based on matching pairs of the one or more detected feature points in the border region and one or more projected feature points in the border region.

A waveguide assembly is disclosed. The waveguide assembly comprises a first waveguide slab and a second waveguide slab. The first waveguide slab is arranged to receive image-bearing light and enlarge a pupil size of the image-bearing light parallel to a first axis. The first waveguide slab comprises a first input coupling device arranged to couple image-bearing light into the first waveguide slab under total internal reflection (TIR), and a first out-coupling region arranged to decouple image-bearing light out of the first waveguide slab by means of reflection. The second waveguide slab is arranged to couple at least a portion of the out-coupled image-bearing light from the first waveguide slab into the second waveguide slab and enlarge the pupil size parallel to a second axis, the second axis substantially orthogonal to the first axis. The second waveguide slab comprises a diffractive in-coupling region and a transmissive diffractive out-coupling region, through which a user can view real world imagery and the out-coupled image-bearing light simultaneously.

An optical device for use in an augmented reality or virtual reality display, comprising: a planar waveguide; an input diffractive optical element, DOE, configured to receive light from a projector and couple the light into the waveguide; the output DOE configured to receive light from the input diffractive optical element in an input direction, expand the light in two dimensions and couple the light out of the waveguide towards a user, the output DOE comprising a first diffractive region configured to diffract light within the waveguide, the first diffractive region having a first direction of periodicity and a second direction of periodicity , wherein an angle between the input direction and the first direction of periodicity is equal and opposite to an angle between the input direction and the second direction of periodicity, wherein the first diffractive region comprises an array of optical structures, wherein each optical structure is oriented in a third direction that is non-parallel to the first and second directions of periodicity, and is configured to couple light out of the waveguide towards the user.

A system includes a spatial light modulator comprising a first substrate, a second substrate, and a liquid crystal layer between the first substrate and the second substrate. The spatial light modulator is characterized by a first retardation and a first phase retardation and has a first slow axis for light propagation. A voltage source is configured to apply a drive voltage to the spatial light modulator and the first retardation of the spatial light modulator is a function of the drive voltage. A retarder is positioned external to the spatial light modulator and is characterized by a second retardation and a second phase retardation. The retarder includes a second slow axis for light propagation. The second retardation has a value such that all illumination wavelengths in a set of illumination wavelengths are above or below a phase retardation value of 0.25. The set of illumination wavelengths includes at least on illumination wavelength in each of at least three different color spectrums.

An optical waveguide device for use in a head up display. The waveguide device provides pupil expansion in two dimensions. The waveguide device comprise a primary waveguide and a secondary waveguide, the secondary waveguide being positioned on a face of the primary waveguide. The secondary waveguide has a diffraction grating on a face opposite to the face which contacts the primary waveguide. The diffraction grating diffracts light into more than diffraction order. Rays diffracted into a non-zero order are trapped in the secondary waveguide by total internal reflection.

A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.

A wallpaper system presents a first wallpaper image of a wallpaper video to a user and receives, via a user input device, one or both of: (i) a spatial user input selection, and (ii) a time user input selection from the user to apply to the wallpaper video. In response to detecting one or both of: (i) the spatial user input selection, and (ii) the time user input selection, the wallpaper system determines one or both of: (i) a respective spatial movement parameter within a wallpaper video associated with the spatial user input selection, and (ii) a respective time coordinate within the wallpaper video associated with the time user input selection. Wallpaper system presents, via the image display, a second wallpaper image associated with one or both of: (i) the respective spatial movement parameter, and (ii) the respective time coordinate.

A display device for use in displaying an augmented reality image of a real-world view or a virtual reality image to a user, the display device comprising an optical waveguide having an input optical element for receiving an image and at least one output optical element for outputting the image, a projector for generating the image, the projector being physically coupled to the optical waveguide, and a projector housing containing at least some components of the projector, the projector housing being relatively moveable with respect to the optical waveguide between a relative position in which a real-world view through the waveguide in the region of the at least one output optical element is occluded and a relative position in which the real-world view through the waveguide in the region of the at least one output optical element is not occluded.

A method of controlling a personal mobility system includes displaying a virtual object on an augmented reality wearable device, the virtual object being located in a position in the field of view of the augmented reality device corresponding to a position in the real world. Proximity of the personal mobility system or a user of the personal mobility system with the position in the real world is detected. In response to the detection of proximity, a performance characteristic of the personal mobility system is modified.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for updating avatar clothing of a user of a messaging system. The program and method provide for receiving, by a messaging application running on a device of a user, a request to identify at least one object depicted in an image captured by a device camera; determining, in response to receiving the request, an attribute of an object depicted in the image; selecting, from plural candidate articles of clothing for an avatar of the user, an article of clothing that is associated with the attribute of the object; and displaying the selected article of clothing with the avatar of the user.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content with a captured image in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image; obtaining supplemental content based on the travel parameter and on the attribute; and displaying an augmented reality content item, which includes the supplemental content, with the captured image.

The technical problem of enhancing the quality of an image captured in low light conditions by a front facing camera is addressed by providing an adaptive front flash system. An adaptive front flash system automatically adjusts configuration parameters of an overlaid view that operates in lieu of a front flash, termed a front flash view. The configuration parameters are adjusted based on characteristics of the output of the digital image sensor of the front facing camera. Examples of configuration parameters of the front flash view include one or more of brightness of the display, color temperature of the front flash view, and transparency of the front flash view.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate context based augmented reality communication between multiple users over a network. Virtual content item configuration data indicative of a selection by a first user of virtual content item to apply to a real-world environment that is visible to a second user via a second device is received from a first device. The virtual content item configuration data also includes one or more criteria to trigger application of the virtual content item to the real-world environment. A triggering event is detected based on satisfaction of the one or more criteria determined from context data generated at the second device. The second device presents the virtual content item overlaid on the real-world environment that is visible to the second user based on the triggering event.

Systems and methods are provided for performing operations including: receiving, via a messaging application of a user device, a request to recover access to an account of a user of the messaging application; accessing a first object corresponding to a first key; receiving, from a first friend of the user on the messaging application, a second object corresponding to a first portion of a second key; receiving, from a second friend of the user on the messaging application, a third object corresponding to a second portion of the second key; deriving the second key based on the second and third objects; and recovering access to the account of the user based on the first key and the second key.

A messaging system for audio character type swapping. Methods of audio character type swapping include receiving input audio data having a first characteristic and transforming the input audio data to an input image where the input image represents the frequencies and intensities of the audio. The methods further include processing the input image using a convolutional neural network (CNN) to generate an output image and transforming the output image to output audio data, the output audio data having a second characteristic. The input audio and output audio may include vocals. The first characteristics may indicate a male voice and the second characteristics may indicate a female voice. The CNN is trained together with another CNN that changes input audio having the second characteristic to audio having the first characteristic. The CNNs are trained using discriminator CNNs that determine whether audio has a first characteristic or a second characteristic.

An optical waveguide combiner includes an optical waveguide substrate and an optical input region. The optical input region includes an optical input diffractive grating integrated in, or disposed on, the optical waveguide substrate. An optical output region includes an optical output diffractive grating integrated in, or disposed on, the optical waveguide substrate, At least one non-diffractive region includes at least one optical non-diffractive array of nanostructures, wherein said at least one optical non- diffractive array of nanostructures is integrated in, or disposed on, the object side of said optical waveguide substrate and at least partially surrounds at least said optical output grating; wherein the external visible reflectance of said at least one non- diffractive array of nanostructures is substantially equal to the external visible reflectance of said optical output grating.

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing make-up based augmented reality content. The program and method provide for receiving a request to present augmented reality content in association with a captured image depicting a face of the user; accessing an augmented reality content item associated with applying makeup to the face and configured to generate a mesh for tracking plural regions of the face; receiving user input selecting a region; determining at least one of a range of color values or a range of contrast values relating to available makeup products for the selected region; and presenting an interface element in association with the face, the interface element for user selection of at least one of a color value within the range of color values or a contrast value within the range of contrast values.

Systems, devices, media, and methods are presented for controlling user interface with an object depicted within the user interface. The systems and methods initiates an augmented reality mode configured to present augmented reality elements within a graphical user interface. A face is detected within a field of view of an image capture component and presented within the graphical user interface. In response to detecting the face, the systems and methods sequentially present a set of augmented reality elements within the graphical user interface. A subset of the augmented reality elements and the face may be depicted contemporaneously. A movement is detected of at least a portion of the face relative to a first augmented reality element and presentation of the first augmented reality element is modified and at least one second augmented reality element is presented.

Methods, systems, and devices for generating a persistent world-space ground (or floor) segmentation map (or "texture") for use in augmented or virtual reality 3D experiences.

Example embodiments described herein therefore relate to an AR guidance system to perform operations that include: detecting a client device at a location within a geo-fenced area, wherein the geo-fenced area may include within it, a destination of interest; determining a route to the destination of interest from the location of the client device within the geo-fenced area; causing display of a presentation of an environment within an AR interface at the client device; detecting a display of real-world signage within the presentation of the environment; generating a media item in response to the detecting the display of the signage within the presentation of the environment, wherein the media item is based on the route to the destination of interest; and causing display of the media item within the AR interface based on the position of the signage within the presentation of the environment.

Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving, by a messaging application, a request to access a third-party resource; in response to receiving the request, obtaining a user interface data corresponding to the third-party resource; generating, for display on a client device, a graphical user interface of the third-party resource based on the markup-language document; generating for display a menu with an option to authorize the third-party resource to access user data from the messaging application; and authorizing the third-party resource to access the user data from the messaging application in response to a user interaction with the menu.

Zusammenfassung wird geladen …

Zusammenfassung wird geladen …

Zusammenfassung wird geladen …

Zusammenfassung wird geladen …

Zusammenfassung wird geladen …

Zusammenfassung wird geladen …