Skip to content

Commit

Permalink
add arc2face
Browse files Browse the repository at this point in the history
  • Loading branch information
foivospar committed Mar 13, 2024
1 parent f49c9c4 commit 13b051b
Show file tree
Hide file tree
Showing 18 changed files with 3,274 additions and 0 deletions.
192 changes: 192 additions & 0 deletions arc2face/index.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,192 @@
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<meta name="description"
content="Arc2Face: A Foundation Model of Human Faces">
<meta name="keywords" content="Arc2Face, ID-embeddings, Stable Diffusion">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Arc2Face: A Foundation Model of Human Faces</title>

<link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro"
rel="stylesheet">

<link rel="stylesheet" href="./static/css/bulma.min.css">
<link rel="stylesheet" href="./static/css/bulma-carousel.min.css">
<link rel="stylesheet" href="./static/css/bulma-slider.min.css">
<link rel="stylesheet" href="./static/css/fontawesome.all.min.css">
<link rel="stylesheet"
href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css">
<link rel="stylesheet" href="./static/css/index.css">

<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script>
<script defer src="./static/js/fontawesome.all.min.js"></script>
<script src="./static/js/bulma-carousel.min.js"></script>
<script src="./static/js/bulma-slider.min.js"></script>
<script src="./static/js/index.js"></script>
</head>
<body>


<section class="hero">
<div class="hero-body">
<div class="container is-max-desktop">
<div class="columns is-centered">
<div class="column has-text-centered">
<h1 class="title is-1 publication-title">Arc2Face: A Foundation Model of Human Faces</h1>
<div class="is-size-5 publication-authors">
<span class="author-block">
<a href="https://foivospar.github.io/">Foivos Paraperas Papantoniou</a>,
</span>
<span class="author-block">
<a href="https://alexlattas.com">Alexandros Lattas</a>,
</span>
<span class="author-block">
<a href="https://moschoglou.com/">Stylianos Moschoglou</a>,
</span>
<span class="author-block">
<a href="https://jiankangdeng.github.io/">Jiankang Deng</a>,
</span>
<span class="author-block">
<a href="https://bernhard-kainz.com/">Bernhard Kainz</a>,
</span>
<span class="author-block">
<a href="https://www.imperial.ac.uk/people/s.zafeiriou">Stefanos Zafeiriou</a>
</span>
</div>

<div class="is-size-5 publication-authors">
<span class="author-block">Imperial College London, UK</span>
</div>

<div class="column has-text-centered">
<div class="publication-links">
<!-- PDF Link. -->
<span class="link-block">
<a href=""
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fas fa-file-pdf"></i>
</span>
<span>Paper</span>
</a>
</span>
<!-- arXiv Link. -->
<span class="link-block">
<a href=""
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="ai ai-arxiv"></i>
</span>
<span>arXiv</span>
</a>
</span>
<!-- Code Link. -->
<span class="link-block">
<a href=""
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fab fa-github"></i>
</span>
<span>Code</span>
</a>
</div>

</div>
</div>
</div>
</div>
</div>
</section>

<section class="hero teaser">
<div class="container is-max-desktop has-text-centered">
<div class="hero-body">
<video id="teaser" autoplay muted loop playsinline width="100%">
<source src="./static/videos/teaser2.mp4"
type="video/mp4">
</video>
</div>
</div>
</section>

<section class="section">
<div class="container is-max-desktop">
<!-- Abstract. -->
<div class="columns is-centered has-text-centered">
<div class="column is-four-fifths">
<h2 class="title is-3">Abstract</h2>
<div class="content has-text-justified">
<p>
This paper presents Arc2Face, an identity-conditioned face foundation model,
which, given the ArcFace embedding of a person, can generate diverse photo-realistic
images with an unparalleled degree of face similarity than existing models. Despite
previous attempts to decode face recognition features into detailed images, we find
that common high-resolution datasets (e.g. FFHQ) lack sufficient identities to reconstruct
any subject. To that end, we meticulously upsample a significant portion of the WebFace42M
database, the largest public dataset for face recognition (FR). Arc2Face builds upon a
pretrained Stable Diffusion model, yet adapts it to the task of ID-to-face generation,
conditioned solely on ID vectors. Deviating from recent works that combine ID with text
embeddings for zero-shot personalization of text-to-image models, we emphasize on the
compactness of FR features, which can fully capture the essence of the human face, as
opposed to hand-crafted prompts. Crucially, text-augmented models struggle to decouple
identity and text, usually necessitating some description of the given face to achieve
satisfactory similarity. Arc2Face, however, only needs the discriminative features of
ArcFace to guide the generation, offering a robust prior for a plethora of tasks where
ID consistency is of paramount importance. As an example, we train a FR model on synthetic
images from our model and achieve superior performance to existing synthetic datasets.
</p>
</div>
</div>
</div>
<!--/ Abstract. -->
</div>
</section>

<section class="section">
<div class="container is-max-desktop">
<!-- Method overview. -->
<div class="columns is-centered">
<div class="column is-full-width">
<h2 class="title is-3">Overview</h2>
<div class="content has-text-justified">
<p>
TBD
</p>
<div>
<img src="./static/images/pipeline.jpg" alt="method" class="center">
</div>
<p>
TBD
</p>
</div>
</div>
</div>
</div>
</section>

<section class="section" id="BibTeX">
<div class="container is-max-desktop content">
<h2 class="title">BibTeX</h2>
<pre><code></code></pre>
</div>
</section>


<footer class="footer">
<div class="container">
<div class="columns is-centered">
<div class="column is-8">
<div class="content">
<p>
The source code of this website is borrowed from <a
href="https://github.com/nerfies/nerfies.github.io">Nerfies</a>.
</p>
</div>
</div>
</div>
</div>
</footer>

</body>
</html>
1 change: 1 addition & 0 deletions arc2face/static/css/bulma-carousel.min.css

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading

0 comments on commit 13b051b

Please sign in to comment.